Preventing Java Maxing Out CPU in Docker Containers
With much of the deployment world moving to Docker and Kubernetes in some wave, shape or form; I’ve been spending a lot more time digging into the minute things that will generally make things better. Working on some of the Synthetica Data Engine jobs which rely on heavily on Java execution, I’ve been reminded again…
Machine Learning book update…. #ai #machinelearning #java #clojure #kafka #dl4j #weka #spark
The first draft of the second edition is complete and a lot of the editing work is done. There are a couple of big changes…. SpringXD has now been replaced with Kafka and how to perform self training machine learning models (with Neural Networks, Linear Regression and Decision Trees). The chapter on Spark got a…
A Little Gotcha in Luminus request in Layout Renders….. #clojure #webdev #luminus
It’s been a while since I looked at the Luminus web development framework for Clojure. I know some folk find it a bit too heavy but I really like it. There have been some changes in releases since I built DeskHoppa so I though I better leave it here incase someone else gets confused by…
Adding file logging to Kafka Connect – #Kafka #Connect #Streaming #Data #Devops
More of a memory aid for me as I’ll forget….. Kafka Connect’s default logging goes to the console, I prefer tailing and grepping files instead. I’m using Confluent Kafka 5.1.2 but the file locations will be pretty much similar if you are using the Apache version. Open up the connect-log4.properties file in $KAFKA_HOME/etc/kafka directory. Add…
“Where have you been hiding?…..” #nitech #ni #machinelearning #ai #customerloyalty #clojure #java
For those who’ve been asking why I’m not so active in NI….. Errrm, I haven’t. So far 2019 has thrown some joyous curve balls. Some good, some challenging but the pointers to learn from were in plain sight. Not Much Conference Talking…. Last year, 2018, was full on tech talks and as much as I…
Apache Storm: From Clojure to Java….. some thoughts. #clojure #java #storm
The route to Clojure can be an odd one. For some it just falls straight in to the developer’s way of working (“It’s Lisp, I geddit!”). Others, like me, with our old Java based OOP heads struggled for the penny to drop. If Java is your main language then the move to Clojure can be…
Finding #pi with #montecarlo method and #Clojure – #math #justmath
I was reading a post from Toward Data Science blog this morning on mathematical programming to build up skills in data science by Tirthajyoti Sarkar. While the article was based around Python it didn’t use any of the popular frameworks like NumPy or SciPy. Now with a bit of a lull I wanted to keep…
DeskHoppa Engineering — Twitter, Kafka and being Data Driven.
This post was originally published on the DeskHoppa Engineering Blog on Medium. We built DeskHoppa on data driven decisions. The technology though is used to augment our decision making, not wholly make it for us. How we choose the hosts we contact is based on data, algorithms and probability. The search and match processes to…
The Annual Pilgrimage to #ClojureX 2018, it’s all about the AI.
I’m not sure how but I got asked back….. ClojureX 2018 runs on 3rd and 4th December at Codenode, hosted by Skillsmatter. Nothing about Onyx this year, promise. All the details here. The full programme here. And I promise I’m going to wear something different this time.
Does Craig’s 10 predict the winner? #data #voting #strictly #strictlycomedancing #clojure
It started with a conversation on Clojurians Slack….. Now, we’ve got some experience with the Strictly scores, we know that linear regression completely trumps neural networks on predicting Darcy’s score from Craig’s score. This however is different and yet still interesting. And as we know we have data available to us up to season 14.…