Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transfer performance #7

Open
librasteve opened this issue Aug 30, 2022 · 5 comments
Open

Transfer performance #7

librasteve opened this issue Aug 30, 2022 · 5 comments

Comments

@librasteve
Copy link
Owner

20:37 discord-raku-bot @japhb I got a CBOR file -- how do I read it in Raku? Using slurp with ":bin" ?
20:49 discord-raku-bot @japhp Yeah, I got it working. And, yes, the CBOR utilization gives me the fastest ingestion of ≈700MB CSV file in Raku.

Some use cases require data transfer - such as using the Rust fast read_csv to import a DataFrame from disk like this:

use Dan;
use Dan::Polars;

my \df = DataFrame.new;
df.read_csv("/tmp/docdir/1mSalesRecords.csv");

say ~df.Dan-DataFrame;   #cast Dan::Polars::DataFrame to raku Dan::DataFrame

A blog post on transfer performance is forthcoming...

@japhb
Copy link

japhb commented Sep 20, 2022

Out of curiosity, did you ever write said blog post? If so, what's the link?

@librasteve
Copy link
Owner Author

Not yet - I am still wrestling with the basic functions - performance is taking a back seat to correct behaviour for now...

@japhb
Copy link

japhb commented Sep 21, 2022

Wise choice. 😁

@ispyhumanfly
Copy link

Hey all, glad this module exists. Looking forward to working with this.

@librasteve
Copy link
Owner Author

Appreciate the feedback ... I have been stuck with a nasty Rust issue for a while, but I think that that is now resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants