The Shopify source supports both Full Refresh and Incremental syncs. You can choose if this connector will copy only the new or updated data, or all rows in the tables and columns you set up for replication, every time a sync is run.
This source can sync data for the Shopify API.
This Source Connector is based on a Airbyte CDK.
This Source is capable of syncing the following core Streams:
- Abandoned Checkouts
- Collects
- Custom Collections
- Customers
- Draft Orders
- Discount Codes
- Metafields
- Orders
- Products
- Transactions
- Pages
- Price Rules
| Integration Type | Airbyte Type | Notes |
|---|---|---|
string |
string |
|
number |
number |
|
array |
array |
|
object |
object |
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Namespaces | No |
Shopify has some rate limit restrictions. Typically, there should not be issues with throttling or exceeding the rate limits but in some edge cases, user can receive the warning message as follows:
"Caught retryable error '<some_error> or null' after <some_number> tries. Waiting <some_number> seconds then retrying..."
This is expected when the connector hits the 429 - Rate Limit Exceeded HTTP Error. With given error message the sync operation is still goes on, but will require more time to finish.
- Go to
https://YOURSTORE.myshopify.com/admin/apps/private - Enable private development if it isn't enabled.
- Create a private application.
- Select the resources you want to allow access to. Airbyte only needs read-level access.
- Note: The UI will show all possible data sources and will show errors when syncing if it doesn't have permissions to access a resource.
- The password under the
Admin APIsection is what you'll use as theapi_passwordfor the integration. - You're ready to set up Shopify in Airbyte!
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.13 | 2021-08-17 | 5470 | Fixed rate limits throttling |
| 0.1.12 | 2021-08-09 | 5276 | Add status property to product schema |
| 0.1.11 | 2021-07-23 | 4943 | Fix products schema up to API 2021-07 |
| 0.1.10 | 2021-07-19 | 4830 | Fix for streams json schemas, upgrade to API version 2021-07 |
| 0.1.9 | 2021-07-04 | 4472 | Incremental sync is now using updated_at instead of since_id by default |
| 0.1.8 | 2021-06-29 | 4121 | Add draft orders stream |
| 0.1.7 | 2021-06-26 | 4290 | Fixed the bug when limiting output records to 1 caused infinity loop |
| 0.1.6 | 2021-06-24 | 4009 | Add pages, price rules and discount codes streams |
| 0.1.5 | 2021-06-10 | 3973 | Add AIRBYTE_ENTRYPOINT for Kubernetes support |
| 0.1.4 | 2021-06-09 | 3926 | New attributes to Orders schema |
| 0.1.3 | 2021-06-08 | 3787 | Add Native Shopify Source Connector |