Category: Java
-
Preventing Java Maxing Out CPU in Docker Containers
With much of the deployment world moving to Docker and Kubernetes in some wave, shape or form; I’ve been spending a lot more time digging into the minute things that will generally make things better. Working on some of the Synthetica Data Engine jobs which rely on heavily on Java execution, I’ve been reminded again…
-
Kafka Is A Team Sport Redux – #kafka #apachekafka #streamingdata #data #confluentkafka
The feedback from Saturday’s blog post Kafka Is A Team Sport was very positive. I still felt I hadn’t quite got my point across though, well not clearly enough. Then it hit me. The Three Functions I see the current ecosystem as three distinct parts. Development, DevOps Engineering and Data Engineering. They all have different…
-
Machine Learning Hands On 2nd edition now available. #machinelearning #ai #java #kafka #clojure #weka #dl4j #spark #r
Towards the end of February the author copies of the second edition of my book, Machine Learning: Hands-on for developers and technical professionals landed on my desk. I’m very happy with the way it’s turned out. I’ve spend the last few months resting, asides from the day job at Digitalis.io – the plan was to…
-
Machine Learning book update…. #ai #machinelearning #java #clojure #kafka #dl4j #weka #spark
The first draft of the second edition is complete and a lot of the editing work is done. There are a couple of big changes…. SpringXD has now been replaced with Kafka and how to perform self training machine learning models (with Neural Networks, Linear Regression and Decision Trees). The chapter on Spark got a…
-
Adding file logging to Kafka Connect – #Kafka #Connect #Streaming #Data #Devops
More of a memory aid for me as I’ll forget….. Kafka Connect’s default logging goes to the console, I prefer tailing and grepping files instead. I’m using Confluent Kafka 5.1.2 but the file locations will be pretty much similar if you are using the Apache version. Open up the connect-log4.properties file in $KAFKA_HOME/etc/kafka directory. Add…
-
“Where have you been hiding?…..” #nitech #ni #machinelearning #ai #customerloyalty #clojure #java
For those who’ve been asking why I’m not so active in NI….. Errrm, I haven’t. So far 2019 has thrown some joyous curve balls. Some good, some challenging but the pointers to learn from were in plain sight. Not Much Conference Talking…. Last year, 2018, was full on tech talks and as much as I…
-
Apache Storm: From Clojure to Java….. some thoughts. #clojure #java #storm
The route to Clojure can be an odd one. For some it just falls straight in to the developer’s way of working (“It’s Lisp, I geddit!”). Others, like me, with our old Java based OOP heads struggled for the penny to drop. If Java is your main language then the move to Clojure can be…
-
Strata London Talk Slides and Code. #stratadata #kafka #dl4j
Proof if proof were needed…. so Strata London was an absolute pleasure to talk at. Those who know me know I’m a big fan of the conference, so to talk at it was an additional boost. Who knew that Strictly data could cross boundaries like that. The slides are available on the Strata website and…
-
Simple Linear Regression in 2 minutes. #machinelearning #linearregression #java
With certain data Simple Linear Regression wins and while the rest of the ML/AI world push tools that are far larger scope than needed for most, sometimes our best tools are hidden in plain sight. Apache Commons Math, old, kinda forgotten but kinda cool, well Simple Linear Regression is hiding in there and is easy…
-
How to run R scripts from Clojure – #clojure #r #datascience #data #java
An interesting conversation came up during a tea break in London meeting this week. How do run R scripts from within Clojure? One was simple, the other (mine) was far more complicated (see the “More Complicated Ways” section below). So here’s me busking my way through the simple way. Run it from the command line…
It's All A Bet - MLOps, DevOps, AI and Synthetic Data Design 