Skip to content

New integrations system - #65

Merged
matt-aitken merged 171 commits into
mainfrom
dev
Feb 21, 2023
Merged

New integrations system#65
matt-aitken merged 171 commits into
mainfrom
dev

Conversation

@matt-aitken

@matt-aitken matt-aitken commented Feb 21, 2023

Copy link
Copy Markdown
Member

The new integration system makes it easier to create integrations using specification files.

It's a separate web service (https://integrations.trigger.dev for our official service) that does the following

  • Provides a list of all the API services it performs with metadata.
  • Performs API requests

When developing you

  1. Create a new "service" (e.g. Airtable)
  2. Add specs for API endpoints. You can use JSON Schemas for the request params/body and potential responses. There is metadata as well that is used to generate a good SDK and documentation
  3. Write automated tests for the endpoints
  4. Generate the SDK (currently it creates a TypeScript SDK and generates docs files for Mintlify)

Coming soon

Webhook support

@matt-aitken
Added the new integrations system into the mono-repo
fc1dd44
@matt-aitken
Created the generated-integrations folder with a Readme
fbdc3c7
@matt-aitken
Renamed command to generate-integrations
63486d2
@matt-aitken
Generate integrations in the correct folder
62ab7e0
@matt-aitken
Got integrations express server up and running
3d5bbf8
@matt-aitken
eslint ignore build folder
76c660f
@matt-aitken
First commit of WIP generated Slack SDK
313a8c5
@matt-aitken
Watch mode working properly with the action endpoint
9751531
@matt-aitken
Added explicit returns types because tsup was complaining
73fb0f3
@matt-aitken
Added target node16 to tsup
4d6963f
@matt-aitken
Fixes for CommonJS in express and tests failing because of access token
76a2c82
@matt-aitken
Progress on action api endpoint
38f32f4
@matt-aitken
The input is validated and results are coming back!
027f021
@matt-aitken
Allow metadata to be passed to the integrations API
c01bc15
@matt-aitken
Created a VS Code workspace
4f7a8f6
@matt-aitken
Created Postgres schema with cache table and PostgresCacheService
5949c98
@matt-aitken
Passing the cache through to requests, it’s working. Made the expecte…
5c8fc81 
…d request metadata specific
@matt-aitken
Add metadata to slack post message
de5b2ca
@matt-aitken
Use __trigger so we don’t have to change the webhooks and introduce i…
a519069 
…ncompatibility
@matt-aitken
The API for integrations is now versioned, accepts params and build c…
1e1da62 
…redentials
@matt-aitken
Added the integrations service to the example Warp config
39d02e6
@matt-aitken
Added version and made response schema optional for SDK requests
caac573
@matt-aitken
Added retryableStatusCodes to a service
011d7d5
@matt-aitken
The integration service now returns the response in the format the we…
5810683 
…bapp is expecting
@matt-aitken
The namespace for the cache includs connection id and workflow id
8a6467f 
Connections are used across workflows, so there was a chance the same key could have been fighting
@matt-aitken
Actually we’re going to cache using connection + service
fb6953b
@matt-aitken
Added live flag to service
8f54740
@matt-aitken
Endpoint that returns information about the services
dfab30c
@matt-aitken
Added API key auth type
84bd5a6
@matt-aitken
Don’t export the service metadata type
974033d
matt-aitken and others added 29 commits February 21, 2023 11:00
@matt-aitken
changeset config for generated-integrations
be6954a
@matt-aitken
Installed packages
e20f7ba
@matt-aitken
Added more ignores to changeset config
154294f
@matt-aitken
Fixed Sendgrid version number
43ceb44
@matt-aitken
Changeset for new integrations service
5df5e30
@matt-aitken
no-frozen-lockfile
5564457
@matt-aitken
Improved changeset pre-release instructions and fixed a config issue
e4efed0
@matt-aitken
Changeset version: created a pre-release 0.3.x
9e739a5
@matt-aitken
Integrations docker frozen-lockfile again
7659835
@matt-aitken
Removed @trigger.dev/sdk dependency from the integrations package.json
f2a0f30
@matt-aitken
Revert "Changeset version: created a pre-release 0.3.x"
2748d9e 
This reverts commit 9e739a5.

# Conflicts:
#	apps/integrations/package.json
@matt-aitken
Latest pnpm lockfile
8836aea
@matt-aitken
Revert "Changeset for new integrations service"
b7ee8fd 
This reverts commit 5df5e30.
@matt-aitken
Changeset added: New integrations service compatibility
6b53aeb
@matt-aitken
Changeset version – next: New integrations service compatibility
d699d38
@matt-aitken
Added generate script to integrations
384752d
@matt-aitken
Don’t restrict access to /healthcheck
727a492
@D-K-P
Updated the healthcheck image
6ced99f
@ericallam
Fix: pass in the id from sendEvent through to the API call
9eeacee
@matt-aitken
serviceFetch basics working. Share some code with requestEndpoint
5880d96
@matt-aitken
The internal CLI can now push API keys to Pizzly from our new integra…
22ae213 
…tions
@matt-aitken
Added airtable to staging client ids
ff57a70
@matt-aitken
Make staging webapp depend on integrations
da0ee48
@matt-aitken
Fix so integration requests can use api_key auth type
88fe24a
@matt-aitken
Add Airtable client_id for prod
26ae66a
@matt-aitken
Prod flightcontrol for integrations
43f913e
@matt-aitken
Increased the p-integrations resources
cde0b7f
@matt-aitken
Added env vars to prod webapp
da9e357
@matt-aitken
Changeset: release version
f5ebde8
@matt-aitken
matt-aitken merged commit 0f75d15 into main Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@matt-aitken @D-K-P @ericallam