PR #20 includes the following updates:
- Reintroduced
_fivetran_deleted
from thegl_detail
source table, as the field was not fully deprecated within in the connector. It is null in normal incremental syncs, but can populate true (or false) in historical resyncs. - This ensures the general ledger models in the downstream
dbt_sage_intacct
transform package exclude deleted records fromstg_sage_intacct__gl_detail
. - Renamed
_fivetran_deleted
to:is_batch_deleted
instg_sage_intacct__gl_batch
is_detail_deleted
instg_sage_intacct__gl_detail
- This ensures column name uniqueness when they are joined into
int_sage_intacct__active_gl_detail
in thedbt_sage_intacct
package.
- Corrected references to connectors and connections in the README. (#19)
- Corrected the
_fivetran_deleted
descriptions in thesrc_sage_intacct.yml
andstg_sage_intacct.yml
documentation.
- Updated
gl_detail
yml and seed files with_fivetran_deleted
documentation and records for testing.
PR #16 includes the following updates:
- Included the
sage_intacct__using_bills
variable as an enablement config for the following models as it was erroneously omitted in previously releases:stg_sage_intacct__ap_bill_item_tmp
stg_sage_intacct__ap_bill_tmp
PR #14 includes the following updates.
- Removal of the
_fivetran_deleted
field from thestg_sage_intacct__gl_detail
table due to this field being deprecated within the connector. The relevant information is now available within thegl_batch
source table.
- Cast the
class_id
field within the following models as{{ dbt.type_string() }}
in order to ensure datatype consistency for the field across models. This also ensures downstream transformation logic withindbt_sage_intacct
compiles successfully.stg_sage_intacct__ap_bill_item
stg_sage_intacct__ar_invoice_item
- Addition of the
gl_batch
source and relevant downstream models:stg_sage_intacct__gl_batch_tmp
stg_sage_intacct__gl_batch
- Updated Maintainer PR Template
- Included auto-releaser GitHub Actions workflow to automate future releases
A very spoooOOOOOooooky release 🎃 👻
- Explicitly casts
department_id
,location_id
, anditem_id
as strings in the stagingap_bill_item
andar_invoice_item
models, which are unioned together downstream insage_intacct_ap_ar_enhanced
(PR #12).
- Incorporated the new
fivetran_utils.drop_schemas_automation
macro into the end of each Buildkite integration test job (PR #11). - Updated the pull request templates (PR #11).
PR #10 includes the following breaking changes:
- Dispatch update for dbt-utils to dbt-core cross-db macros migration. Specifically
{{ dbt_utils.<macro> }}
have been updated to{{ dbt.<macro> }}
for the below macros:any_value
bool_or
cast_bool_to_text
concat
date_trunc
dateadd
datediff
escape_single_quotes
except
hash
intersect
last_day
length
listagg
position
replace
right
safe_cast
split_part
string_literal
type_bigint
type_float
type_int
type_numeric
type_string
type_timestamp
array_append
array_concat
array_construct
- For
current_timestamp
andcurrent_timestamp_in_utc
macros, the dispatch AND the macro names have been updated to the below, respectively:dbt.current_timestamp_backcompat
dbt.current_timestamp_in_utc_backcompat
- Dependencies on
fivetran/fivetran_utils
have been upgraded, previously[">=0.3.0", "<0.4.0"]
now[">=0.4.0", "<0.5.0"]
.
- Removed the
_fivetran_deleted
filter in thestg_sage_intacct__gl_account
. We saw there were records in thegl_detail
table that were associated with accounts that were deleted, which affected our joins and bubbled up later in the final P&L and balance sheet models. By removing the filter the balances tie out. However, we've kept_fivetran_deleted
as a column so the user may filter that out on their own. (#8)
-
Excludes fivetran-deleted rows in the staging models (#7)
-
Allow for pass-through columns from the
gl_detail
andgl_account
source tables using the following variables. For more information please refer to the READMEsage_account_pass_through_columns
sage_gl_pass_through_columns
-
Add variable configs for the AP Bill and AR Invoice related tables to allow users to disable them if not used. For more information please refer to the README
sage_intacct__using_bills
sage_intacct__using_invoices
-
Include additional fields in the
gl_detail
model: customer_id, customer_name, department_id, department_title, location_id, location_name, vendor_id, and vendor_name.
(#6)
Thank you @santi95 for raising these to our attention! (#6)
- This is the initial release of this package.
This package is designed enrich your Fivetran data by doing the following:
- Add descriptions to tables and columns that are synced using Fivetran
- Add freshness tests to source data
- Add column-level testing where applicable. For example, all primary keys are tested for uniqueness and non-null values.
- Model staging tables, which will be used in our transform package
Currently the package supports Postgres, Redshift, BigQuery, Databricks and Snowflake. Additionally, this package is designed to work with dbt versions [">=1.0.0", "<2.0.0"].
- For more information refer to the README.