Founder & CTO at Crate.io
Über die letzten 7 Jahre – während ich Crate gegründet und mit aufgebaut habe – hatte ich über zahlreiche Finanzierungsrunden Gelegenheit Pitches zu üben und zu “delivern”. Ich habe mich sehr gefreut, darüber mit Boris Gloger darüber eine Podcastfolge aufzunehmen.
PS.: Boris ist mit QLAB gerade selbst gerade dabei, wieder ein Start-up zu gründen. Dazu gibts auch eine Folge auf Boris’ Blog.
This has originally been posted on the Crate.io blog end of September 2020.
Today I’m announcing my departure from Crate.io, the company I cofounded 7+ years ago and have been building together with a great team.
I’ve had many roles at Crate.io over the years, and today I have a new, final one – a still convinced user and ambassador of CrateDB. But I will no longer be part of day-to-day operations. Instead, after obsessing for so many years over distributed databases and building a strong engineering culture built on trust, it’s time to move on and focus on solving other problems on this planet. Going forward I’ll use my experience and endurance to tackle them in any way I can.
Seven years ago, Bernd Dorn, Manfred Schwendinger and me built the first version of CrateDB and then we configured our startup: Manfred had to take care of our pre-existing business, I took the CEO role, Bernd, the best coder and architect was the natural choice as CTO and Christian Lutz, with his experience and success in funding, building and selling tech companies initially as our COO. Our goal was to make scaling super simple. CrateDB and “Big Data SQL in Real-Time” did a picture-perfect launch: HackerNews, trending Github repository, TechCrunch, Gigaom, TheNextWeb, Pioneers,…
It was crystal clear that building an open source database is a long-term, difficult undertaking requiring lots of VC funding, which would allow us to build together a successful business and raise capital in multiple rounds.
Machine generated data – including Time Series Data – is the fastest growing database segment and the fully distributed SQL query engine of CrateDB is the perfect foundation for the enterprise IOT market.
End of 2015 it was again a natural move that I took the CTO seat and Christian took over the CEO seat to build out with the team the commercial part of the company and execute professional VC fundraises in UK and Silicon Valley.
End of 2016 we tipped the cow, released CrateDB 1.0 and also started monetizing our product. This led to a global, strong growth of users and we transitioned from an engineering-only r&d company to a financially successful B2B enterprise business and also raise our Series A.
Today, 7 years and 360 CrateDB releases later, Crate.io is grown-up and is a revenue driven enterprise business with large customers and partners, and even more ambitious growth targets than ever. That’s why the board of directors brought in Eva Schönleitner as CEO, Christian got appointed as President to the board and I am happy to see Bernd coming back and taking again the engineering lead as CTO. To be able to pursue that huge opportunity that lies ahead of Crate the leadership team needs to evolve and guide the company to further growth. As a leaving executive I couldn’t be happier to see that the company is set up for success and find a new role.
As a founder, of course, I have mixed emotions. When you create a company, your job is to make sure it can one day succeed without you. Then eventually that one day comes and the celebration can be bittersweet.
It’s never easy for a founder to part ways with their work. I know that most ideas never materialize. Most software goes unused. Most businesses fail in their first years but we didn’t and here we are. Now, with Petabytes of data being processed by CrateDB, some of the largest and most successful businesses using CrateDB in their core processes, being recognized by Forbes Magazine and named a Cool Vendor by Gartner you know that your work was meaningful, and that a vibrant group of customers and partner will continue building upon it…. can any founder ask for anything more?
I want to thank from the bottom of my heart every Cratie – our team members, past and present, for making Crate.io what it is today. Thanks to you, this founder’s bittersweet moment is mostly sweet. I look forward to seeing where you will take it next.
Thank you
Jodok
What started with an Cathode powered screencast ends with the same:
Mein Freund Boris Gloger ist ein besonderer Mensch. Mich verbinden viele Sachen mit ihm. Wir wollten und wollen immer noch mehr gemeinsam unternehmen. Ein erster kleiner Schritt ist, dass wir es endlich geschafft haben, einen ersten Podcast aufzunehmen.
Hört euch an, was wir zum Thema “unternehmen” plaudern:
“Die Ideen gehen mir nicht aus”, Jodok Batlogg ist Gründer und Geschäftsführer von Crate.io in Dornbirn. Außerdem ist er Informatiker und mehrfacher Entrepreneur, der bereits sieben Unternehmen aufgebaut hat und nun das achte Jahr im aktuellen Unternehmen Crate.io angeht. Ausgehend von einer – für ihn – glasklaren Idee einer hochskalierbaren Datenbank für maschinengenerierte Daten (z.B. Sensordaten, Daten in der industriellen Produktion) gründete er das Start-up Crate.io und fing dafür wieder einmal bei Null an.
Ich unterhalte mich mit Jodok darüber, wieso er es nicht lassen kann, was ihn antreibt und welche Hürden er überwinden musste. Er erzählt uns ein wenig über seine Produktidee, was seinen Lebensstil als Unternehmer ausmacht und wie er das gesamte Unternehmen denkt. Silicon Valley spielt natürlich auch ein Rolle.
Ich wünsche euch viel Spaß beim Zuhören!
Boris Gloger
A couple of weeks ago my friend “Menze” a.k.a. Gerhard Beer from Hittisau introduced me to the great people from Digital Instinct. As many of us they were impacted by COVID-19 as well. However every challenge also unlocks a lot of potential.
The movie (german) is about you, how you can unlock potentials NOW, just do it. Let yourself be inspired:
There business is to make films for others. However, they decided to finally devote their talent and passion to create a film for themselves. And share it with the world.
I’m one of multiple protagonists. It was great to see the perfectionism and love for detail the team put into the movie. You don’t really see them in the movie, therefor I’d like to show them here:
But even for my small contribution we spent close to a full day in the Forest, with my Bees and in the office to capture a couple of impressions.
The result is marvelous! Watch the full movie on the Digital Instict Website.
I had the opportunity to record an episode of the “Digitale Leute Podcast” with my friend Oliver Thielmann from Giant Swarm and would like to reshare it here as well:
Being at number one at Hacker News or winning the TechCrunch Disrupt Startup Battle might help create a hype around your startup. But it doesn’t help finding the product-market fit. Jodok Batlogg, CTO at industrial IoT startup Crate.io explains in this episode why they needed six years to finally hit product-market fit.
Digitale Leute Insights is the podcast for passionate product people. We interview product developers from around the world and take a closer look at their tools and tactics.
Subscribe via: Soundcloud, Spotify, Deezer, Google Podcasts or Apple Podcasts.
When Jodok Batlogg was the CTO at StudiVZ, the largest social network in Germany before Facebook got traction in Europe, the biggest problem they had was data storage. The data of 60 million users were running on about a thousand servers and Docker had not been invented yet. It was clear to Jodok that the amount of data would be growing and the problems with it.
Four years later, he founded Crate.io with a prototype of CrateDB. The open-source distributed SQL database management system used Elastic Search when that was still “a crazy guy sitting in Israel coding at a new kind of approach on how to deal with distributed computing,” as Jodok puts it in this episode.
His startup enjoyed two hypes early. The first one was a Hacker News article that resulted in the company going into the “Big Data SQL in real-time” direction. The second boost came after winning the TechCrunch Disrupt Startup Battle, which Jodok completed with a broken fibula. Although it helped to keep the company alive with bringing in investors, they were still to find product-market fit, Jodok admits. “On the product side, it was fine, but from the going-to-market side and on the monetization side, it was totally wrong.”
The turnaround came as late as five years after the foundation when the company did a customer survey. The result was a transformation to a more enterprise-focused company concentrating on industrial IoT. They switched the open-source model, which allowed the customers to perceive Crate.io as a product worth buying. It also helped the sales department actually to sell the product. Before that, even hiring extra sales employees had resulted in zero sales.
Today Crate.io is a remote-first company, led by Jodok Batlogg as CTO from Dornbirn, a small town in Vorarlberg, Austria. The mountainous country and Jodoks attempt to not use his Audi anymore leads him to try out all the new electric boards, bikes, and gadgets on the market. He shares this passion with our host Oliver Thylmann. This is why they close this episode by discussing electromobility and paying it with bitcoin.
About the Host
Oliver Thylmann is a serial entrepreneur based in Cologne, Germany. He is the co-founder of Giant Swarm, a 35-person SaaS company providing managed microservice infrastructure to big enterprises.
The iPhone 11 Pro camera is just amazing. I’m no longer on Instagram, account dormant for 2 month (soon to be deleted). Therefor I wanted to share a few shots.
I’m impressed when I see how much the quality of the photos taken has improved. Recently I used the night mode for the first time.
This picture was taken ~18:30 in February (it was almost dark). The mountains look very different when lighted that way. Beautiful.
When it comes to shooting things that are dark and light, the iPhone also finds a perfect balance. Mystic.
As comparison I tried to find some older pictures, and here’s what I found (roughly 20 years old, shot on an Digital IXUS – a really good compact camera at this time).
The crispyness of pictures taken is just incredible. I’m excited to see how this evolves going forward.
Recently I came across this tweet of Steve O’Grady (he helped to found Redmonk, a research firm I really value highly).
Especially this Graph stroke me. This is what I predicted 6 years ago. NoSQL isn’t the solution. And one of the main reasons we’ve built CrateDB.
Providing a SQL interface to a NoSQL architecture was and is one of the key and core ideas of CrateDB. CrateDB is purpose-built to scale modern applications. SQL is a major component of that.
The first wave – and the reason SQL was invented – were relational databases. The start was SEQUEL, invented around 1977 by IBM for System R. SQL1 became an ANSI standard in 1986, in the 2003 Version Window functions were added and SQL:2016 got JSON support.
Glad to see that SQL is back still strong. There are many reasons why it is great and we fully rely on it. But the main point to talk about:
“The good thing about standards is that there are so many to choose from.”
Andrew S. Tanenbaum
Over the past 20+ years some of the brightes computer scientists thought about how to best work with data. SQL has 4 language subcategories:
Querying Data (DQL)
(CrateDB’s querying commands)
That’s what you do most of the time. CrateDB excels when it comes to querying data. Nowadays real-time analytics usecases of require aggregations (SELECT SUM(revenue)) out of a table (FROM my_table) that is potentially large (billions of rows) at are limited to a subset of these rows by a filter clause (WHERE ts>myts AND id=myid). Benchmarks show that we consistenly outperform other query engines for these types of queries. Add JOINs to the mix and the complexity explodes – read about the complexity involved to make that really fast. Not only on standard data types, but also on modern things like geospatial data.
Manipulating Data (DML)
(CrateDB’s manipulating commands)
Correct, to be able to query data, you need to start with writing data to the database, in single rows, in batches, via bulk load, updates or from other queries). CrateDB is fully standard compliant, the only slight difference is based on the eventual consistent model (also read about optimistic concurrency control) that CrateDB uses: it might take up to the REFRESH_INTERVAL until records are fully considered in results (selecting by primary key is always consistent).
Defining Schemas (DDL)
(CrateDB’s definition commands)
Here’s where on needs a bit more that the original SQL standard had in. We’re storing JSON data and need the possibility to define object columns (that can have a strict schema, a dynamic schema or a simply not indexed). Btw. schemas are a great idea – storing data without a schema is just postponing problems.
When it comes to scaling to large amounts of data, the concepts of sharding, partitioning and replication are key. Here’s where the knowledge of an database administrator is needed. In contrast to a traditional database, where you can change more aspects of a table after creation, you need to think of and define more settings beforehand. I don’t think this is a problem, all of you that ever were forced to do hour long schema migrations where the database was locked – will agree.
Rights and Transaction Control (DCL, DTL)
Now we’re talking about differences. Traditional OLTP databases and their workloads heavily rely on transactions and fine-grained permissions. But this comes at a high price (performance, speed, concurrency ). A price one in the IoT or Timeseries space doesn’t want to pay. Especially because the yield is low. Therefore CrateDB supports user-management, but no further functionality (yet).
In case you want to learn more about SQL or look up some reference documentation – at Crate.io we’ve acquired the rights to republish the fantastic SQL-99 Complete, Really book. So for all oldskool SQL fanbois – here’s a teaser – World’s Longest SQL Poem (for obvious reasons)
All the snake-oil peddlers say, there's a fast and easy way, To get your SQL program up and running, But they're silent re the traps, that cause subtly buggy apps, For to catch the unaware a chasm's yawning! Date-arithmetic exceptions, auto-rollbacked disconnections, Bit precisions, overflows, collate coercions, And how NULL affects your summing, for to keep your DB humming, You must know what happens in all vendors' versions! Should this field be DOUBLE PRECISION? Will logic rules soon see revision? By the ANSI:Databases sub-committee? When you DROP should you CASCADE? How are NATURAL joins made? Re UNIQUE-keys matching check the nitty-gritty! Yeah the true and standard facts, you'll avoid those later hacks That make Structured Query Language such a bore, You'll find tips and charts aplenty, in this one-thousand-and-twenty Four page volume (with an index), and yet more!
Author anon (also for obvious reasons)
TL;DR: I’m deleting my Whatsapp account.
Bye, bye.
You can still reach me via Signal (iOS, Android), phone, SMS/iMessage, E-Mail or on Twitter.
Undoubtfully – it’s a very handy tool. More than 1.5 billion people use it. Free cross-platform messaging, free group chat, free calls, free video calls. This was (and is) game-changing. Revolutionary 10 years ago!
Extremely impressive backend technology, written in Erlang. In 2015 WhatsApp had only 50 engineers handling 900M users. That was roughly one year after Facebook acquired WhatsApp for $19BN. I honestly admired the team as I know what it means to build a messaging service for millions of users.
WhatsApp is Facebooks second biggest property. Facebook is making money with the data for their users – YOUR DATA.
The price is too high. Your messages, your messaging metadata, your friends, your connections,…
Guess why the WhatsApp Founder Brian Acton left Facebook 2018 – 4 years after the acquisition and left $850M on the table?
“I sold my users’ privacy… I live with that every day”
CNBC Interview with Brian Acton
The encrypted message from the number used by Mohammed bin Salman (Saudi crown prince) is believed to have included a malicious file that infiltrated the phone of the world’s richest man, according to the results of a digital forensic analysis.
The Guardian (January 2020): Jeff Bezos phone got hacked via WhatsApp.
Jeff Bezos got a video message. That video message infiltrated the phone, and the hackers could get access to all content on this phone.
But wait – you’ve also voluntarly granted these permissions to WhatsApp. Are you sure you trust Facebook?
Privacy comes at a price. I’m willing to pay the price. Even if Billions of users act otherwise and take part in that game.
This is the logical next step on my journey to become Facebook (the company) free. After deleting my Facebook account I’m now deleting my Whatsapp account. I’ve requested my data, it’s ready today.
Instagram is next.
I encourage you to do the same. It feels great and will feel great in future.
Hi, welcome to the team. I’m so glad you are here at Crate. You’re now a Cratie!
You’ll need at least one cycle to figure this place out. Maybe even two cycles. That’s totally o.k. – take your time. Uh? a cycle? What’s that? Let’s call it 1-2 quarters (of a year) for now.
When entering a new environment, the first impression is really important. And we’re working hard to make the first experience a good one. But as we’re a bunch of curious, different and complex people solving complex problems this will take some time. Btw. complex is still better than complicated1.
Be curious, meet everyone, look around, ask all the questions, write and talk to whomever you want. I bet there are many new acronyms, habits and rituals to learn. This will time until you’re fully productive. We expect that. In case you feel unsafe or don’t dare to ask someone, you have multiple fallbacks: your onboarding buddy, your lead person or just me.
Company culture is reflecting the people working there. What you do is who you are2. It started based on the belief of the two founders – Christian and me. Over the last 6 years we kept a lot of principles, but also carefully changed others.
The following paragraphs are a user guide to navigate Crate and navigate it. It captures what you can expect out of working as part of the team, our aspirations and the leadership values that influence our culture.
My intent is to accelerate the working relationship between all of us with this document.
People work from where they want and when they want. It might seem this is less efficient than having all people at one place for fixed hours. But we’ve deliberatly decided to craft a remote-friendly culture that even allows people in different timezones to be included. It makes us resilient and adaptable. It is sustainable. We’ll do as many things asynchronously and in written format as possible. People working in one of the offices have the advantage of meet at the espresso machine – and have random chats. But even if you are remote or in a different office you will be able to see and talk with your team mates at least once per day: During the daily coffee – a video call that the team does once a day. This call is about social interaction, staying connected and getting better known to each other. The teams decide themselves how to organize the rest of the work and agile methodology. One nice weekly ritual worth mentioning for the people sharing a location is the weekly team lunch – we cook something together in Dornbirn and invite you to go for lunch in other locations.
It’s up to you and your lead to agree on a schedule to set expectations, about cadence and structure/tools of 1:1s and related topics.
We have a bi-weekly all-hands meeting (attendance optional) where the leadership will present a summary about what’s going on in the different areas of the business and is also open to questions. The meeting is also recorded in case you can’t attend.
You can contact the founders 24hours a day. Don’t worry. We’re used to that and have tuned the notifications of our phones and other tools in a way that is in harmony with our private life. If we don’t want to be disturbed we’ll manage to not be disturbed.
If one of us is traveling, out of office, ill or on vacation, we update our status beforehand in Pingboard3. All our meetings still occur albeit with time zone considerations.
Some of us work now and then on weekends, evenings or early mornings. Some start later, some leave earlier. This is their choice. We do not expect that you are going to work on the weekend, evenings or early mornings. We might be sending mails and Slack messages, but unless the thing says URGENT, it can always wait until work begins for you on Monday.
It’s up to you to find your work/life balance, be an integrated part of a team that delivers results. We’ll help you to do so.
We all take vacations. You should, too. Disconnected from work is when we do some of the best work.
Simply Sustainable takes a major concern and common claim – simplicity – and qualifies with the ultimate payoff: sustainability, an application and a business that can scale and maintain itself ad infinitum.
It’s forward looking – in a world of data overload, this is how we do more than survive: it’s how we thrive.
Sustainability demands balance, playing well with others, moving forward with peace of mind. And who doesn’t want it to be simple??
Crate is a team of passionate, experienced people who’ve crafted a bold and clever database for the fast, data-intensive world, making speed, scalability super simple, open, and accessible – a solution that’s built to be sustainable for all.
Crate.io Brand Story
Clever. We’re passionate people with a love of technology and a lot of experience. But technologic breakthroughs don’t just come from knowing your stuff. They come from looking at things from different angles and flipping the situation around: they come from being clever.
Bold. We believe in being bold, in the power of having a vision and the gumption to realize it, however radical. Being bold means seeing the big picture and believing you can impact it, shape it, make it better.
Open. The best solutions come from people listening to each other as they share information, insight, and experience. Which is why we are fanatically open and honest — listening to our customers, being good citizens of the open source community, building with others to make solutions better.
Simple. It takes a deep understanding of the craft, coupled with human empathy, to render the complex simple. To make it accessible for all. In everything we do, from how we configure data and integration with existing systems to user dashboards, documentation, and support, we aim to keep it all super simple. Because data should work for everyone.
Sustainable. We believe the best solutions are sustainable, supporting communities and businesses as they grow. Which is why we believe in working together, building on each other’s advances, all in order to create open and accessible solutions that are sustainable for all.
Our Values are the guiding principles that lead to what we do on a daily basis. They are the parameters that tune our decision process that results in how we behave if no one watches. This is what we call culture.
You can rely on those values, and you can demand them at any time.
Meaningfulness. At any time we offer to explain the meaningfulness and relationale of tasks, goals and measures.
Success. We strive towards and celebrate joint success.
Colleguality. We offer a work environment based on collaboration and cooperation. At the same time we respect everyone’s individuality.
Esteem. We appreciate and respect each and everyone and their opinions and provide open and honest feedback.
Challenge. It is our aspiration to provide everyone with the opportunity to grow by taking on new and challenging tasks.
Self-determination. There is as much room for self-determination as possible.
Joy. By Living Our Values above we gain happiness and satisfaction.
We firmly believe that the process of setting, expressing and matching expectations is at the core of building trust and respect in a team. This requires the continuous process of giving and receiving feedback.
At Crate.io, there is a formal feedback cycle which occurs twice a year. We have outlined the structure of an appraisal interview in a separate document.
Meetings take time, we take care about our mutual time. Therfor we have a couple of principles for our meetings. First of all we deliberately run our calendars publicly visible. If you have a question about any meeting on any calendar, just ask. If a meeting is private or confidential, you’ll most likely just see a placeholder. The vast majority of meetings are neither private nor confidential.
Each meeting has to include an agenda and/or intended purpose, the appropriate amount of productive attendees, and the expected contribution of the parties invited. If Craties are attending a meeting, they prefer starting on time. If Craties are running a meeting, they will start that meeting on time. If it’s not clear to a Cratie why they are in a meeting, they will ask for clarification on their attendance.
If you send a presentation deck a reasonable amount of time before a meeting, we will read it before the meeting and will have our questions ready. If we haven’t read the deck, we will tell you.
If a meeting completes its intended purpose before it’s scheduled to end, let’s give the time back to everyone. If it’s clear the intended goal won’t be achieved in the allotted time, let’s stop the meeting before time is up and determine how to finish the meeting later.
Being a diverse team is a priceless advantage. Because tolerance creates creativity. And creativity is the most precious ingredient of the future. It’s essential to have different personalities in a team. We embrace this fact – but also move out of comfort zone when needed.
We don’t put people into boxes. But to concern oneself with different scientific models helps us to work better together.
We always assume positive intent for all involved. Whenever a person takes a decision, it’s the best decision that he/she can take in that moment.
If someone of us is on the phone during a meeting for more than 30 seconds, say something. It’s easy to get distracted nowadays.
This document is a first braindump of myself – speaking as one of the founders and CTO. This is not my creation, but I was privileged to work as part of a system of people that shaped our culture and my thinking.
When I came across Rands in repose article „How To Rands“, I decided to take this as template, rework it and use as basis for a wider discussion within the Crate.io Team, but also the public.
I would like to update it with you, make it a shared thing all of us can underwrite, and therefor would appreciate your feedback. I‘ll turn this into a Github document in case we need to improve tooling to collaboratively work on that document.
[2] What you do is who you are, by Ben Horowitz
Full disclosure: This post was heavily inspired by Rands in repose article “How To Rands”.
I like a lot of the principles that are built into the programming language Python. Some of the principles are also applicable to “real” life.
They’re a bit hidden and most people don’t know them and have never seen them. They’re easy to get as they’re built into every python interpreter.
Simply start python and enter import this:
For better readability I’ve formatted (and numbered) them here
1. Beautiful is better than ugly.
2. Explicit is better than implicit.
3. Simple is better than complex.
4. Complex is better than complicated.
5. Flat is better than nested.
6. Sparse is better than dense.
7. Readability counts.
8. Special cases aren’t special enough to break the rules.
9. Although practicality beats purity.
10. Errors should never pass silently.
11. Unless explicitly silenced.
12. In the face of ambiguity, refuse the temptation to guess.
13. There should be one– and preferably only one –obvious way to do it.
14. Although that way may not be obvious at first unless you’re Dutch.
15. Now is better than never.
16. Although never is often better than right now.
17. If the implementation is hard to explain, it’s a bad idea.
18. If the implementation is easy to explain, it may be a good idea.
19. Namespaces are one honking great idea — let’s do more of those!
