Polyglot on the JVM with Graal

InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
polyglot-jvm-graal

Presented at QCon New York
www.qconnewyork.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Polyglot on the JVM
with Graal
Thomas Wuerthinger
Senior Research Director, Oracle Labs
@thomaswue
QCon New York, June 2017

Safe Harbor Statement
The following is intended to provide some insight into a line of research in Oracle Labs. It
is intended for information purposes only, and may not be incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality, and should not be
relied upon in making purchasing decisions. The development, release, and timing of any
features or functionality described in connection with any Oracle product or service
remains at the sole discretion of Oracle. Any views expressed in this presentation are my
own and do not necessarily reflect the views of Oracle.
3

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 4
The World Is Polyglot!
Java
C
C++
Python
C#
VB.NET
JavaScript
Assembly language
PHP
PerlRubyVBSwift
R
Objective-C
Go
MATLAB
Delphi/Object Pascal
PL/SQL
Scratch
Others
PROGRAMMING LANGUAGE POPULARITY
(TOP 20 LANGUAGES FROM MAY 2017 TIOBE INDEX)

Polyglot Challenges
Only languages with high industry attention achieve high performance.
Languages require different tools for configuring, debugging, profiling…
Languages execute in their own box with costly serialization between boxes.

Graal Vision
High performance for all languages
Language-level virtualization layer for shared manageability and tooling
Zero overhead interoperability between languages

You can execute any language on the JVM / CLR
- as long as it looks like Java / C#.
Mismatch between type system and bytecodes of host VM and
semantics of guest language.

After 5+ years of research…

U
U U
U
U I
I I
G
G I
I I
G
G
Node Rewriting
for Profiling Feedback
AST Interpreter
Rewritten Nodes
AST Interpreter
Uninitialized Nodes
Compilation using
Partial Evaluation
Compiled Code
Node Transitions
S
U
I
D
G
Uninitialized Integer
Generic
DoubleString
Optimization and Speculation…

I
I I
G
G I
I I
G
G
Deoptimization
to AST Interpreter
D
I D
G
G D
I D
G
G
Node Rewriting to Update
Profiling Feedback
Recompilation using
Partial Evaluation
And Deoptimization!

Graal VM Architecture
Java HotSpot VM
JVM Compiler Interface (JVMCI) JEP 243
Graal Compiler
Truffle Framework
Sulong
(LLVM)

Let‘s talk about R...
14
function(a, x) (a[x]+42)
• Does „+“ resolve to the addition builtinfunction?
• Class of „a“?
• Does „[]“ resolve to the array access builtinfunction?
• Is „x“ a vector of specific length?
• Does „x“ have negative elements? The 0 element? Positive elements?
In-bounds or out-of-bounds? An NA element?
• Any code can be executed at the point where „a“ or „x“ is evaluated
(lazy promise evaluation of arguments)
• Does evaluated code redefine „+“ or „[]“ functions?
• Is intermediate vector result needed?

Graal.js Architecture
JavaScript
C++
Java
node modules with only JavaScriptnode modules with native extensions
node standard library
node bindings (socket, http, …)
V8 API
thread
pool
(libeio)
event
loop
(libev)
DNS
(c-ares)
crypto
(OpenSSL)
Graal.js JavaScript Engine
Adapter V8 API to Graal.js via JNI
native extensions
Fully compatible including native module support!

Project Sulong: LLVM front-end for Graal
int add(x, y) {
return x + y;
} define i32 @add(i32 %x, i32 %y) #0 {
%1 = alloca i32, align 4
%2 = alloca i32, align 4
store i32 %x, i32* %1, align 4
store i32 %y, i32* %2, align 4
%3 = load i32* %1, align 4
%4 = load i32* %2, align 4
%5 = add nsw i32 %3, %4
ret i32 %5
}
FUNCTION add(x, y)
INTEGER :: add
INTEGER :: a
INTEGER :: b
add = a + b
RETURN
END FUNCTION
func add(x int, y int) int {
return x + y;
}
https://github.com/graalvm/sulong
C/C++
Fortran
Go

High-Performance for Each Language
17
1.02 1.2
4.1
4.5
0.85 0.9
0
1
2
3
4
5
Java Scala Ruby R Native JavaScript
Speedup, higher is better
Performance on 64-bit x86 on well-known benchmark suites relative to:
HotSpot/Server, JRuby, GNU R, LLVM AOT compiled, V8
Graal
Best Specialized Competition

Twitter Evaluated Early Version of Graal
• Large number of Scala microservices
• More Tweets per CPU msec in their core service
• https://www.jfokus.se/jfokus17/preso/Graal-at-Twitter.pdf

Zero Overhead Interoperability
19

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 20
Graal runtime supports complete separation of physical and
logical layout for guest language data structures.

• Defining lambda method in JavaScript:
• Calling from same language:
• Or from other language (e.g., Java):
• Or from custom memory layouts:
Ø row-oriented format => raw pointer to current row and schema
Ø column-oriented format => two raw pointers to current positions within columns and schema

#include<stdio.h>
struct complex {
double r;
double i;
}
int main() {
struct complex *a = …;
struct complex *b = …;
add(a, b);
}
function add(a, b) {
var result = {r:0, i:0};
result.r = a.r + b.r;
result.i = a.i + b.i;
return result;
}
add(a, b)
a->r b->r
a->i b->i
main.c
complex.js
Data Sharing Across Language Boundaries

1x
8x
11x
32x
0
5
10
15
20
25
30
35
CRuby Graal/Ruby CRuby+C Graal/Ruby+C
Image Processing Composite Speedup
Pure Ruby Ruby + C
Higherisbetter

DEMO

Graal Extended Vision
High performance, polyglot, language-level virtualization layer…
embeddable across the stack in native and JVM-based applications.

Resources on Graal
• OTN product page including download:
– www.oracle.com/technetwork/oracle-labs/program-languages
• Graal projects on github:
– github.com/graalvm
• Graal on OpenJDK:
– openjdk.java.net/projects/graal
26

Q/A
27
@graal
@thomaswue

Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
polyglot-jvm-graal

Polyglot on the JVM with Graal

Recommended

Recommended

More Related Content

More from C4Media

More from C4Media (20)

Recently uploaded

Recently uploaded (20)

Polyglot on the JVM with Graal