Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Type the Saleforce data based on the Saleforce DataDictionary #43

Open
s7clarke10 opened this issue Aug 3, 2023 · 0 comments
Open

Type the Saleforce data based on the Saleforce DataDictionary #43

s7clarke10 opened this issue Aug 3, 2023 · 0 comments

Comments

@s7clarke10
Copy link
Contributor

s7clarke10 commented Aug 3, 2023

Salesforce has a separate API to the one used for ingestion to provide information on the Data Dictionary.

I believe that before data is ingested for each Salesforce table that a call could be made to the Salesforce Data Dictionary URL to dump as Salesforce data dictionary JSON response. This could be parsed to inform what a schema should look like for the Salesforce Table. I believe the landed data could be enriched as much as possible. It would be nice to include field descriptions so that there is information about the column in the landed table on the target side as well - Note: I haven't examined whether the Singer Spec can supply column and table comments (but that would be super cool).

It is relevant to refer to this issue as well #42 as it would be good exclude compound fields when looking at this issue.

To find out more about the Salesforce Data Dictionary and dumping the Data Dictionary look at this github repo https://github.com/s7clarke10/get-salesforce-data-dictionary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant