Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement from_json_to_structs #2510

Open
wants to merge 67 commits into
base: branch-24.12
Choose a base branch
from
Open

Implement from_json_to_structs #2510

wants to merge 67 commits into from

Commits on Oct 16, 2024

  1. Implement castStringsToBooleans 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    1376061 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.12' into convert_table 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    ff2f340 View commit details
    Browse the repository at this point in the history

  3. Implement removeQuotes 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    c3fa10d View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Rewrite using offsets and chars 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    ae2b41f View commit details
    Browse the repository at this point in the history

  2. Fix empty input 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    8d7ad2e View commit details
    Browse the repository at this point in the history

  3. Misc 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    9e759c4 View commit details
    Browse the repository at this point in the history

  4. Add nullifyIfNotQuoted option for removeQuotes 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    2fff949 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Implement castStringsToDecimals 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d09de41 View commit details
    Browse the repository at this point in the history

  2. Implement removeQuotesForFloats 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    576b65c View commit details
    Browse the repository at this point in the history

  3. Fix removeQuotesForFloats 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    2bd5335 View commit details
    Browse the repository at this point in the history

  4. Implement castStringsToIntegers 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    21c80a5 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Implement non-legacy castStringsToDates 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    1a7d192 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. WIP for cast_strings_to_dates_legacy 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    dcb463e View commit details
    Browse the repository at this point in the history

  2. Revert "WIP for cast_strings_to_dates_legacy" 

    This reverts commit dcb463e.
    @ttnghia
    ttnghia committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    f059c21 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    207d6a3 View commit details
    Browse the repository at this point in the history

  2. Fix compile issues 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    07b23ea View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. WIP: Implement from_json_to_structs 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    de83a25 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    443ca38 View commit details
    Browse the repository at this point in the history

  3. Fix cmake 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    6c2bd5e View commit details
    Browse the repository at this point in the history

  4. Fix compile issues 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    904d857 View commit details
    Browse the repository at this point in the history

  5. Implement castStringsToFloats 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    d84f1fe View commit details
    Browse the repository at this point in the history

  6. WIP 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    3024583 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. WIP: Implementing fromJSONToStructs 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    d33d8e2 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    295c36c View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. Fix compile errors 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1ea9cc8 View commit details
    Browse the repository at this point in the history

  2. Cleanup 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    c1bb2d4 View commit details
    Browse the repository at this point in the history

  3. Revert code as we still need them

    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    f6634b4 View commit details
    Browse the repository at this point in the history

  4. Add error check 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    06b2c19 View commit details
    Browse the repository at this point in the history

  5. Add more comments 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    2dcdd11 View commit details
    Browse the repository at this point in the history

  6. Cleanup 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    f3c391b View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Return as-is if the column is date/time 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    52c42a6 View commit details
    Browse the repository at this point in the history

  2. Update test 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    19c64be View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    cb9d252 View commit details
    Browse the repository at this point in the history

  4. Update cudf 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    5d07db1 View commit details
    Browse the repository at this point in the history

  5. Revert "Update cudf" 

    This reverts commit 5d07db1.
    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    39e3a9b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    8628136 View commit details
    Browse the repository at this point in the history

  7. Update cudf

    @ttnghia
    ttnghia committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    df1428d View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Merge branch 'branch-24.12' into convert_table 

    # Conflicts:
#	src/main/cpp/src/JSONUtilsJni.cpp
#	src/main/cpp/src/json_utils.cu
#	src/main/cpp/src/json_utils.hpp
#	thirdparty/cudf
    @ttnghia
    ttnghia committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    0fd8d0e View commit details
    Browse the repository at this point in the history

  2. Update cudf

    @ttnghia
    ttnghia committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    1d48906 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. Change header

    @ttnghia
    ttnghia committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    d9e1db5 View commit details
    Browse the repository at this point in the history

  2. Rewrite JSONUtils.cpp

    @ttnghia
    ttnghia committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    0f053a6 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. Implement a common function for converting column 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    8912e00 View commit details
    Browse the repository at this point in the history

  2. Rewrite convert_data_type 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    3614718 View commit details
    Browse the repository at this point in the history

  3. Remove cast_strings_to_dates 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    6d9bbdc View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Implement convert_data_type 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a832938 View commit details
    Browse the repository at this point in the history

  2. Fix compile errors 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    44b885b View commit details
    Browse the repository at this point in the history

  3. Add CUDF_FUNC_RANGE(); 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ab45de8 View commit details
    Browse the repository at this point in the history

  4. Fix schema 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    89e74a0 View commit details
    Browse the repository at this point in the history

  5. Complete from_json_to_structs 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    27ef532 View commit details
    Browse the repository at this point in the history

  6. Fix null mask 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    5b65712 View commit details
    Browse the repository at this point in the history

  7. Write Javadoc 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6788471 View commit details
    Browse the repository at this point in the history

  8. Rewrite JNI 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    49c78ce View commit details
    Browse the repository at this point in the history

  9. Merge branch 'branch-24.12' into convert_table 

    # Conflicts:
#	src/main/cpp/src/json_utils.hpp
#	thirdparty/cudf
    @ttnghia
    ttnghia committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9d16d43 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Remove deprecated function 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    bb9029b View commit details
    Browse the repository at this point in the history

  2. Revert test 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    1243599 View commit details
    Browse the repository at this point in the history

  3. Remove header 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    6f89fcd View commit details
    Browse the repository at this point in the history

  4. Rewrite Javadoc 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    deb3ebf View commit details
    Browse the repository at this point in the history

  5. Rename variable 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    9dc641f View commit details
    Browse the repository at this point in the history

  6. Rewrite docs 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    53b121d View commit details
    Browse the repository at this point in the history

  7. Revert test 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    69265b4 View commit details
    Browse the repository at this point in the history

  8. Cleanup headers 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    da4d1f6 View commit details
    Browse the repository at this point in the history

  9. Cleanup 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    1d91e64 View commit details
    Browse the repository at this point in the history

  10. Rewrite the conversion functions 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    d0fa2ae View commit details
    Browse the repository at this point in the history

  11. Move code 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    f375a4d View commit details
    Browse the repository at this point in the history

  12. Remove call to make_structs_column 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    034a5ec View commit details
    Browse the repository at this point in the history

  13. Cleanup 

    Signed-off-by: Nghia Truong <[email protected]>
    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    74d858c View commit details
    Browse the repository at this point in the history

  14. Merge branch 'branch-24.12' into convert_table

    @ttnghia
    ttnghia committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    7a32b6f View commit details
    Browse the repository at this point in the history