Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

source-oracle-flashback: float types with precision < 18 are not string #2212

Merged
merged 2 commits into from
Dec 17, 2024

Conversation

mdibaiee
Copy link
Member

@mdibaiee mdibaiee commented Dec 16, 2024

Description:

  • When emitting documents, we emit numbers with a precision higher than 18 as python's decimal.Decimal, which is then encoded as a JSON string. This is applied on all numeric types. When doing discovery, we were correctly discovering NUMBER columns with a precision of less than 18 as type: number, and those with a higher precision as type: string, format: number, but we were not doing the same thing for FLOAT types (DOUBLE PRECISION is an alias for FLOAT(126)). Updated that code so that discovery's behavior matches the emitted values.

Workflow steps:

(How does one use this feature, and how has it changed)

Documentation links affected:

(list any documentation links that you created, or existing ones that you've identified as needing updates, along with a brief description)

Notes for reviewers:

(anything that might help someone review this PR)


This change is Reviewable

@mdibaiee mdibaiee changed the title source-oracle-flashback: float types with precision < 16 are not string source-oracle-flashback: float types with precision < 18 are not string Dec 17, 2024
@mdibaiee mdibaiee force-pushed the mahdi/float-discovery branch from fc8aceb to 087807e Compare December 17, 2024 13:18
@mdibaiee mdibaiee force-pushed the mahdi/float-discovery branch from 2f5adeb to 6ceb859 Compare December 17, 2024 13:50
Copy link
Contributor

@Alex-Bair Alex-Bair left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mdibaiee mdibaiee merged commit 2fc6ece into main Dec 17, 2024
75 of 80 checks passed
@mdibaiee mdibaiee deleted the mahdi/float-discovery branch December 17, 2024 13:56
@mdibaiee mdibaiee added the change:planned This is a planned change label Dec 17, 2024
@mdibaiee mdibaiee linked an issue Dec 17, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
change:planned This is a planned change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

oracle: CDB support and flashback fixes (column types?)
2 participants