Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Second attempt with various improvements #510

Merged
merged 22 commits into from
Jan 31, 2024
Merged

Second attempt with various improvements #510

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
d3ba8a7
Initial chunked impl
JamalMulla Jan 5, 2024
e564255
Bytes instead of chars
JamalMulla Jan 5, 2024
81802e0
Improved number parsing
JamalMulla Jan 6, 2024
78e3c3b
Custom hashmap
JamalMulla Jan 7, 2024
7e40d06
Graal and some tuning
JamalMulla Jan 8, 2024
31de444
Fix segmenting
JamalMulla Jan 8, 2024
42b34d4
Fix casing
Jan 8, 2024
c3b5966
Unsafe
Jan 8, 2024
6ab6882
Inlining hash calc
Jan 8, 2024
c7ad374
Improved loop
Jan 8, 2024
4eb2eda
Cleanup
Jan 8, 2024
58c33ff
Speeding up equals
Jan 8, 2024
756120a
Simplifying hash
Jan 8, 2024
ee2b765
Replace concurrenthashmap with lock
Jan 9, 2024
db62fc3
Small changes
Jan 10, 2024
3cf1ce1
Script reorg
Jan 11, 2024
b52ce52
Native
Jan 13, 2024
577fc3a
Lots of inlining and improvements
Jan 14, 2024
4e3109d
Merge branch 'gunnarmorling:main' into main
JamalMulla Jan 20, 2024
fc897b6
Add back length check
Jan 20, 2024
b58548e
Fixes
Jan 21, 2024
2d13d02
Small changes
Jan 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions calculate_average_JamalMulla.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,5 +15,11 @@
# limitations under the License.
#

JAVA_OPTS="--enable-preview -XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields -XX:+UseTransparentHugePages"
java $JAVA_OPTS --class-path target/average-1.0.0-SNAPSHOT.jar dev.morling.onebrc.CalculateAverage_JamalMulla


if [ -f target/CalculateAverage_JamalMulla_image ]; then
target/CalculateAverage_JamalMulla_image
else
JAVA_OPTS="--enable-preview -XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields -XX:+UseTransparentHugePages -XX:-TieredCompilation"
java $JAVA_OPTS --class-path target/average-1.0.0-SNAPSHOT.jar dev.morling.onebrc.CalculateAverage_JamalMulla
fi
8 changes: 7 additions & 1 deletion prepare_JamalMulla.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,10 @@
#

source "$HOME/.sdkman/bin/sdkman-init.sh"
sdk use java 21.0.1-graal 1>&2
sdk use java 21.0.2-graal 1>&2

# ./mvnw clean verify removes target/ and will re-trigger native image creation.
if [ ! -f target/CalculateAverage_JamalMulla_image ]; then
NATIVE_IMAGE_OPTS="--gc=epsilon -O3 -march=native --enable-preview --strict-image-heap --link-at-build-time -R:MaxHeapSize=64m -da -dsa --no-fallback --initialize-at-build-time=dev.morling.onebrc.CalculateAverage_JamalMulla"
native-image $NATIVE_IMAGE_OPTS -cp target/average-1.0.0-SNAPSHOT.jar -o target/CalculateAverage_JamalMulla_image dev.morling.onebrc.CalculateAverage_JamalMulla
fi
Loading
Loading