YHK - yet another hacker news clone

TornadoVM 7 Enables GPU-Native Workloads from Java Applications

64 points pjmlp 2 days ago 11 comments

mikepapadim 2 hours ago | parent

https://github.com/beehive-lab/TornadoVM this is main repo.

You can use it with any JDK21+ and Nvidia or Apple hardware and their Nvidia libs or MLX libs.

Akseleu_omirbay 1 hour ago | parent

And what about TPU support? Is it compatible with Google TPUs or strictly limited to gpu backends like CUDA and Metal?

mikepapadim 1 hour ago | parent

no TPU support yet, just NVIDIA, Apple and any other HW thats supports OpenCL

the_arun 2 hours ago | parent

Does this mean we can use Java to build AI infrastructure?

vlowrian 2 hours ago | parent

Or an abstract AI infrastructure factory?

mikepapadim 2 hours ago | parent

https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java

kitd 1 hour ago | parent

I'll be disappointed if this isn't named AbstractAiInfrastructureFactory

pjmlp 1 hour ago | parent

These kind of complaints get tiresome, here for some Objective-C fun,

https://github.com/Quotation/LongestCocoa

keeda 1 hour ago | parent

That’s probably the next thing after Software Factories.

amir734jj 2 hours ago | parent

Basically JAX for Java instead of Python

mikepapadim 2 hours ago | parent

Many components for a jax for java are already tested in https://github.com/beehive-lab/jitllm