How to use DMA or RDMA in java?

Question

"DMA" here means: Direct memory access, and "RDMA" is: remote direct memory access.

I used Java to created an application to transfer stock data, but I found the latency is bigger than I expected. I heard someone developed same type application used "DMA/RDMA", which has good performance, so I wonder if I can use "DMA/RDMA" in Java?

If not, what language should I use, and if there are any good libraries to use?

LordDoskias · Accepted Answer · 2011-10-19 11:19:57Z

6

This article from IBM developers work give a great overview of how DMA access can be achieved using java

answered Oct 19, 2011 at 11:19

LordDoskias

3,1913 gold badges34 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

9000 Over a year ago

The article shows how to allow other parts of the OS to do DMA on Java-created data and achieve zero-copy data transfers. (Cool, if you ask me.)

Freewind Over a year ago

@LordDoskias, thank you, zerocopy is a good advice, I will try it later

LordDoskias Over a year ago

Well in order to achieve DMA access of any kind you HAVE to rely on the underlying OS. So each JVM version has platform-specific code which exposes this capability through means of filechannels. So in a sense you are getting all the goodies that come from using DMA

JC1 · Accepted Answer · 2016-02-24 05:29:08Z

3

You have two options (that I know of):

Java SDP -- has been deprecated
JXIO [1], a high-performance messaging library built on RDMA and supported by Mellanox

[1] https://github.com/accelio/JXIO

answered Feb 24, 2016 at 5:29

JC1

6871 gold badge9 silver badges23 bronze badges

1 Comment

Mike Argyriou Over a year ago

Also JSOR from IBM: ibm.com/support/knowledgecenter/en/SSYKE2_7.1.0/…

Community · Accepted Answer · 2017-05-23 12:19:14Z

2

There is DiSNI, a new library to program RDMA in Java. DiSNI is the open source variant of IBM's jVerbs. There are some performance numbers here that illustrate how RDMA with Java compares to sockets in C and Java, and also to RDMA in C.

edited May 23, 2017 at 12:19

CommunityBot

11 silver badge

answered Aug 9, 2016 at 8:27

pstuedi

1511 silver badge5 bronze badges

Comments

NPE · Accepted Answer · 2011-10-19 11:24:16Z

1

RDMA as I know it is a property of the networking infrastructure (along with the relevant kernel modules etc), not of the application-level programming language.

In other words, you'd have to get specialized kit to make use of RDMA to reduce network latency. Here is an example of a 10GbE network card that supports RDMA: link.

edited Oct 19, 2011 at 11:24

answered Oct 19, 2011 at 10:52

NPE

503k114 gold badges970 silver badges1k bronze badges

Comments

Konstantin Pribluda · Accepted Answer · 2011-10-19 10:54:14Z

0

Java applications are capable of mmaping files via nio packages. Those mmaped files can be accesses by multiple programs - I affraid this is closes thing to DMA available in java

answered Oct 19, 2011 at 10:54

Konstantin Pribluda

12.3k1 gold badge33 silver badges38 bronze badges

Comments

Andy Malakov · Accepted Answer · 2015-03-05 02:00:05Z

0

Java 7 supports SDP protocol on Solaris and Linux (with OpenFabrics.org drivers). Unfortunately SDP protocol has been deprecated in the 2.x version of OFED. People resort to JNI wrappers like jVerbs.

answered Mar 5, 2015 at 2:00

Andy Malakov

8679 silver badges6 bronze badges

Collectives™ on Stack Overflow

How to use DMA or RDMA in java?

6 Answers 6

3 Comments

1 Comment

Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

6 Answers 6

3 Comments

1 Comment

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related