Author's posts

So, you have a startup idea?

How to materialize it in roadmap and keep only what is important? Idea is good, but the devil usually hides in the details and you want to uncover it ASAP. MVP should help you assess demand and validate your product hypothesis. In order to convert your idea to a list of action items – it …

Continue reading

Hash (mis)usage: tales from the prod

Few observations in regards to hash usage, in projects where data volume and spikes in load shift engineering from the KISS paradigm to the extent where you have to really care about underlying technologies and data structures. There are different hash functions tailored for different use cases – quick pattern matching in Rabin-Karp algorithm, prefix …

Continue reading

Which type of database index you should use?

Overview of available type of indexes in different database engines and corresponding use cases. So, you have some data. Most likely you want to work with it – i.e. retrieve information according to some conditions = filtering what is important for you. Probably, even change the shape of this information – transform the data or …

Continue reading

Language of the data

My ultimate SQL Memo

LLM derive schema from unstructured data and build pyspark ETLs

still, understanding what you can do via plain SQL – allow you to choose what to ask and leverage insights from the data much more efficient

no magick wand – hard work 🙂

Building data dashboards in python

Discovering for myself recent advancements in frontend development via Python: Lets say, you would need to quickly sketch the UI for EDA and share it with someone else.You started playing with data in Positron IDE but what next? Which options do you have, when matplotlib/plotly/seaborn/altair/ <you named> rendered diagrams are not enough? Metabase – can …

Continue reading

How to increase throughput of your engineering teams?

How to choose your database?

Use Postgres! Use whatever you have the most experience with! Every software design discussion should start with the game of questions to clarify what we are about to build. And what not. Boundaries are important to have a clear cut from a very shiny but probably too remote future with hundreds of thousands requests per …

Continue reading

How to scale web-application

Yep, application can’t handle load anymore. Alerts, exceptions, timeouts. Vertical scaling helps for couple of weeks and then everything is start failing again. And it become noticeably expensive for short-term solutions. Ouch. Good news – it means that users love your product = strong signal in regards to PMF journey! Client profile: scale-up company Domain: …

Continue reading

Architecture of modern startup

hype wave, pragmatic evidence vs need to move fast Tech side of startups sometimes can be very fluid and contain a lot of unknowns. What tech stack to use? Which components might be overkill for now but worth keeping an eye for in the future? How to balance the pace of business features development while …

Continue reading

Machine Learning at the edge

Few learnings on migrating computer vision pipeline from python prototype at AWS to cpp in smartphones One of the projects that we have been working was Smart Mirror – we want to build a technology that will hint user how to looks better at the photo. It has bunch of fascinating tasks to tackles – …

Continue reading