The Apache Commons Math library has a RealMatrix interface. I haven’t tried EJML, but it looks like it has a lot more.

https://commons.apache.org/proper/commons-math/javadocs/api-3.6.1/org/apache/commons/math3/linear/RealMatrix.html