Oct 22
Few observations in regards to hash usage, in projects where data volume and spikes in load shift engineering from the KISS paradigm to the extent where you have to really care about underlying technologies and data structures. There are different hash functions tailored for different use cases – quick pattern matching in Rabin-Karp algorithm, prefix …
Oct 09
Overview of available type of indexes in different database engines and corresponding use cases. So, you have some data. Most likely you want to work with it – i.e. retrieve information according to some conditions = filtering what is important for you. Probably, even change the shape of this information – transform the data or …
Sep 16
My ultimate SQL Memo
LLM derive schema from unstructured data and build pyspark ETLs
still, understanding what you can do via plain SQL – allow you to choose what to ask and leverage insights from the data much more efficient
no magick wand – hard work 🙂
Sep 04
Discovering for myself recent advancements in frontend development via Python: Lets say, you would need to quickly sketch the UI for EDA and share it with someone else.You started playing with data in Positron IDE but what next? Which options do you have, when matplotlib/plotly/seaborn/altair/ <you named> rendered diagrams are not enough? Metabase – can …
Nov 02
hype wave, pragmatic evidence vs need to move fast Tech side of startups sometimes can be very fluid and contain a lot of unknowns. What tech stack to use? Which components might be overkill for now but worth keeping an eye for in the future? How to balance the pace of business features development while …
Sep 06
Few learnings on migrating computer vision pipeline from python prototype at AWS to cpp in smartphones One of the projects that we have been working was Smart Mirror – we want to build a technology that will hint user how to looks better at the photo. It has bunch of fascinating tasks to tackles – …
Jan 31
Databases – how they work under the hood? Key takeaways from brilliant book “Designing data intensive application” – to quickly recap core concepts. DB engines classifications Type of load: OLTP (transaction processing) vs OLAP (data warehousing and analytics) Relational vs NoSQL, document vs columnar, graph vs triple-store (semantic facts storage) Even within NoSQL camp you can …
Aug 31
TLDR; Crypto-arbitrage bot code is released here – https://github.com/kruglov-dmitry/crypto_crawler. I can’t develop in c++ fast enough, not yet within golang sect, so have to use python. It was painfully educative fun. Chronicles of one crypto-arbitrage bot Some time ago friend of mine, innocent in terms of exposure to bloody details of executing mid-term IT projects, …
Jul 22
From my perspective mastering particular language is still secondary skills for programmer. For sure it will affects architecture of software and may add advantages for some use cases of handling data flows, but overall, in the long run, decent design of system coupled with carefully catered algorithms much more important. Nonetheless within this article I …
