New integrations system - #65

Merged

matt-aitken merged 171 commits into

mainfrom

Feb 21, 2023

Commits on Feb 13, 2023

Added the new integrations system into the mono-repo
matt-aitken
committed
fc1dd44
Created the generated-integrations folder with a Readme
matt-aitken
committed
fbdc3c7
Renamed command to `generate-integrations`
matt-aitken
committed
63486d2
Generate integrations in the correct folder
matt-aitken
committed
62ab7e0
Got integrations express server up and running
matt-aitken
committed
3d5bbf8
eslint ignore build folder
matt-aitken
committed
76c660f
First commit of WIP generated Slack SDK
matt-aitken
committed
313a8c5
Watch mode working properly with the action endpoint
matt-aitken
committed
9751531
Added explicit returns types because tsup was complaining
matt-aitken
committed
73fb0f3
Added target node16 to tsup
matt-aitken
committed
4d6963f
Fixes for CommonJS in express and tests failing because of access token
matt-aitken
committed
76a2c82
Progress on action api endpoint
matt-aitken
committed
38f32f4
The input is validated and results are coming back!
matt-aitken
committed
027f021
Allow metadata to be passed to the integrations API
matt-aitken
committed
c01bc15
Created a VS Code workspace
matt-aitken
committed
4f7a8f6
Created Postgres schema with cache table and PostgresCacheService
matt-aitken
committed
5949c98
Passing the cache through to requests, it’s working. Made the expected request metadata specific
matt-aitken
committed
5c8fc81
Add metadata to slack post message
matt-aitken
committed
de5b2ca
Use __trigger so we don’t have to change the webhooks and introduce incompatibility
matt-aitken
committed
a519069

Commits on Feb 14, 2023

The API for integrations is now versioned, accepts params and build credentials
matt-aitken
committed
1e1da62
Added the integrations service to the example Warp config
matt-aitken
committed
39d02e6
Added version and made response schema optional for SDK requests
matt-aitken
committed
caac573
Added retryableStatusCodes to a service
matt-aitken
committed
011d7d5
The integration service now returns the response in the format the webapp is expecting
matt-aitken
committed
5810683
The namespace for the cache includs connection id and workflow id
matt-aitken
committed
8a6467f
Actually we’re going to cache using connection + service
matt-aitken
committed
fb6953b
Added live flag to service
matt-aitken
committed
8f54740
Endpoint that returns information about the services
matt-aitken
committed
dfab30c
Added API key auth type
matt-aitken
committed
84bd5a6
Don’t export the service metadata type
matt-aitken
committed
974033d
Removed old todo
matt-aitken
committed
259e28e
Created an IntegrationsClient that’s used to communicate with the integrations service
matt-aitken
committed
8039f32
Renamed IntegrationMetadata to ServiceMetadata
matt-aitken
committed
d60e9ae
Renamed slug to service
matt-aitken
committed
e013c6f
Downgraded vitest in the webapp because it caused typecheck issues
matt-aitken
committed
b2bd170
Migrated the metadata format
matt-aitken
committed
d807421
Added authentication middleware to the integrations service
matt-aitken
committed
6a3ffa6
WIP getting the new integrations working with the old ones
matt-aitken
committed
140d02f
Added displayProperties functionality to the endpoints/actions
matt-aitken
committed
108bb62
Added test for action displayProperties and made a fix
matt-aitken
committed
7bc11fe
Removed logging in the auth middleware
matt-aitken
committed
c359962
The display properties endpoint is working
matt-aitken
committed
a96bfd3

Commits on Feb 15, 2023

Make the api use v2 (as v1 was the old integrations system)
matt-aitken
committed
30c0984
Added icon to the services API json
matt-aitken
committed
4874288
Added version to the Display properties are working for v1 integrations
matt-aitken
committed
558b705
Services metadata being pulled from old and new systems
matt-aitken
committed
bfa096d
The API won’t respond with services that aren’t live
matt-aitken
committed
8320131
DisplayProperties stored on a run step and first read from there
matt-aitken
committed
08ecd28
Reverted workflowRunStep.server.ts
matt-aitken
committed
9db77b6
Added .template to the end of the template files so turbo doesn’t pick up on them
matt-aitken
committed
23dbeff
Renamed the new slack integration slackv2
matt-aitken
committed
f8ac055
Include generated-integrations in the workspace
matt-aitken
committed
3ce5d5b
Generate the SDK with the correct endpoint name
matt-aitken
committed
6854435
Created an example that uses the slackv2 integration
matt-aitken
committed
75d6471
Debugging the webapp should use infisical
matt-aitken
committed
81ddf59
Get the display properties when creating an integration request
matt-aitken
committed
eb98f50
Add the version info to a created IntegrationRequest
matt-aitken
committed
454bfcc
The DisplayProperties are now returned properly from the API
matt-aitken
committed
b142c55
Make the slack example not live
matt-aitken
committed
fa80ca0
Started work on Airtable
matt-aitken
committed
15316a7
Fix generate test to point at slackv2
matt-aitken
committed
5a312de
Added Airtable to the catalog
matt-aitken
committed
7e92e8c
Deleted pointless generateService test
matt-aitken
committed
2261a76
Made the Airtable fields a loose schema for now
matt-aitken
committed
192a1d2
Deleted slackv2 example
matt-aitken
committed
7b24248
Added descriptions to the response fields
matt-aitken
committed
d99446a
Created Airtable example
matt-aitken
committed
8d15e9a
Fix so the integration actually responds
matt-aitken
committed
2acd79f
Remove unused integrations index file
matt-aitken
committed
3b67a5c
Added nock
matt-aitken
committed
5fc1236
Airtable example working
matt-aitken
committed
a94c8e4
Added morgan logging to the integrations server
matt-aitken
committed
1410688
Moved the logger below express json
matt-aitken
committed
c2e9acc
Use nock to return from the API
matt-aitken
committed
98cac16
Tidied up the mad nock reply
matt-aitken
committed
25cf024

Commits on Feb 17, 2023

Renamed the code that used open api specs
matt-aitken
committed
c75181f
An easier way to write JSON Schemas
matt-aitken
committed
92ca01f
WIP Airtable schemas
matt-aitken
committed
27e1d13

Commits on Feb 18, 2023

Created an AirTable field schema
matt-aitken
committed
2adea4c
Airtable Field schema
matt-aitken
committed
d07a54f
Added listRecords endpoints with improvements to generating schemas
matt-aitken
committed
232b58d
Reworked how nock works to allow updating
matt-aitken
committed
1f5053b
listRecords is working
matt-aitken
committed
b5128ab
Added update/upsert records
matt-aitken
committed
b969653
Update single record
matt-aitken
committed
fd90e3c
Create mutiple and single records
matt-aitken
committed
6e337eb
Delete records and record
matt-aitken
committed
f2e341e

Commits on Feb 19, 2023

Make multiple actions at once
matt-aitken
committed
05af0ba
When making schemas don’t add properties with undefined values, it messes up the Typescript generator
matt-aitken
committed
0c36c3e
Don’t format the types when creating them from schemas
matt-aitken
committed
dbd4e9a
WIP on de-duplicating type definitions from generated SDK
matt-aitken
committed
1b53ccb
Deduplicated type definitions, but still has multiple interfaces
matt-aitken
committed
4449965
Generate types by creating a combined schema
matt-aitken
committed
0d918e7
Separate schema titles and descriptions so we get nice TypeNames and jsdocs
matt-aitken
committed
3ad8a0a
Ignore missing patterns when linting
matt-aitken
committed
c7e926a
Newly generated SDKs using the new generator
matt-aitken
committed
e6d6bfc
Prepared code generation for docs
matt-aitken
committed
0913a34
Started generating docs, with metadata first
matt-aitken
committed
584b124
Decent param field generation
matt-aitken
committed
e84e43e
Much better generated docs
matt-aitken
committed
4b3c9b7
Generate much nicer params
matt-aitken
committed
08338d1
output the response types
matt-aitken
committed
d32aa49
Generate docs with good support for oneOf and anyOf
matt-aitken
committed
86e1e71
Generated docs for Slack example and Airtable
matt-aitken
committed
3796ba5
Fix for generateTypes test now we don’t format
matt-aitken
committed
55f04d5
Deal with validating when a schema is undefined or data is undefined
matt-aitken
committed
ac1354b
Add support for api_key authentication
matt-aitken
committed
fe598ff
Response body is optional
matt-aitken
committed
20d8493
Added scopes to api_key authentication method
matt-aitken
committed
679239d
SendGrid mailSend endpoint implemented
matt-aitken
committed
889d991
Fixes for an optional body in the response
matt-aitken
committed
0112648
Generated SendGrid SDK
matt-aitken
committed
8da0f9a

Commits on Feb 20, 2023

Sanitize text for mdx (so we can display HTML tags on the page)
matt-aitken
committed
24203d1
Update SendGrid’s documentation
matt-aitken
committed
3a0a6e4
Make the params default open
matt-aitken
committed
3b76574
Regenerated docs with default open on params
matt-aitken
committed
8dfdfdb
Merge remote-tracking branch 'origin/dev' into features/new-integrations
matt-aitken
committed
3cd4f2f
Fix for bad import of WorkflowsPresenter
matt-aitken
committed
06f2fc3
Fixing issues with service metadata
matt-aitken
committed
c76d930
More fixes from mege conflict
matt-aitken
committed
d4939c4
Installed packages
matt-aitken
committed
ab92e95
Moved all presenters into the presenters folder
matt-aitken
committed
4e2fe3d
Fix for typecheck issue
matt-aitken
committed
9bb8363
Added infisical config to the root
matt-aitken
committed
9f6886c
Added scopes to api_key authentication in the web app
matt-aitken
committed
679ac99
Created marketingContacts endpoint
matt-aitken
committed
036ffa7
Removed $ref from SendGrid marketingContacts endpoint schema
matt-aitken
committed
e2693eb
Generated SendGrid SDK
matt-aitken
committed
a5a5dcb

Commits on Feb 21, 2023

WIP on integration.fetch
matt-aitken
committed
4aae45e
Merge branch 'features/new-integrations' into dev
matt-aitken
committed
f6ed551
Added healthcheck
matt-aitken
committed
c7c5d40
Setup flightcontrol for integrations
matt-aitken
committed
a6f9e1e
Created integrations Dockerfile
matt-aitken
committed
b34018e
Delete not-exported slack integration
matt-aitken
committed
a38945e
Changed version number for Airtable
matt-aitken
committed
0efbbec
Doesn’t change the generated package.json file if it exists
matt-aitken
committed
a704451
Fix for type error with optional outpyt JSONSchema
matt-aitken
committed
810996f
changeset config for generated-integrations
matt-aitken
committed
be6954a
Installed packages
matt-aitken
committed
e20f7ba
Added more ignores to changeset config
matt-aitken
committed
154294f
Fixed Sendgrid version number
matt-aitken
committed
43ceb44
Changeset for new integrations service
matt-aitken
committed
5df5e30
no-frozen-lockfile
matt-aitken
committed
5564457
Improved changeset pre-release instructions and fixed a config issue
matt-aitken
committed
e4efed0
Changeset version: created a pre-release 0.3.x
matt-aitken
committed
9e739a5
Integrations docker frozen-lockfile again
matt-aitken
committed
7659835
Removed @trigger.dev/sdk dependency from the integrations package.json
matt-aitken
committed
f2a0f30
Revert "Changeset version: created a pre-release 0.3.x"
matt-aitken
committed
2748d9e
Latest pnpm lockfile
matt-aitken
committed
8836aea
Revert "Changeset for new integrations service"
matt-aitken
committed
b7ee8fd
Changeset added: New integrations service compatibility
matt-aitken
committed
6b53aeb
Changeset version – next: New integrations service compatibility
matt-aitken
committed
d699d38
Added generate script to integrations
matt-aitken
committed
384752d
Don’t restrict access to /healthcheck
matt-aitken
committed
727a492
Updated the healthcheck image
D-K-P
committed
6ced99f
Fix: pass in the id from sendEvent through to the API call
ericallam
committed
9eeacee
serviceFetch basics working. Share some code with requestEndpoint
matt-aitken
committed
5880d96
The internal CLI can now push API keys to Pizzly from our new integrations
matt-aitken
committed
22ae213
Added airtable to staging client ids
matt-aitken
committed
ff57a70
Make staging webapp depend on integrations
matt-aitken
committed
da0ee48
Fix so integration requests can use api_key auth type
matt-aitken
committed
88fe24a
Add Airtable client_id for prod
matt-aitken
committed
26ae66a
Prod flightcontrol for integrations
matt-aitken
committed
43f913e
Increased the p-integrations resources
matt-aitken
committed
cde0b7f
Added env vars to prod webapp
matt-aitken
committed
da9e357
Changeset: release version
matt-aitken
committed
f5ebde8