Software Engineering

Why is Continuous Delivery for ML/AI hard(er)?

Since the challenge is not new and many valid solutions exist targeting traditional software projects, is there a reason to treat ML/AI systems any differently? Consider these three core challenges that are endemic in ML, AI, and data projects:

1. Development and debugging cycles are more tedious due to

... See more

• Solution : Apply the Single Responsibility Principle - each microservice should focus on one single capability that it masters.


• Benefits : This specialization makes microservices easier to comprehend, test, scale, and upgrade. It's like having a coordinated team where each member excels at their role.


• Pitfalls : Violating this principle leads to

... See more

We ship often

Shipping early is not enough. We also need to keep shipping tiny iterations daily instead of waiting months to ship something big.

Having a strong sense of urgency , and making hard decisions fast is how we enable that process. Our sprints only last 1 week and are quite short when compared to the rest of the industry - this is by... See more

Pyinstrument is a Python profiler. A profiler is a tool to help you optimize your code - make it faster. To get the biggest speed increase you should focus on the slowest part of your program. Pyinstrument helps you find it!

☕️ Not sure where to start? Check out this video tutorial from calmcode.io!

Installation

pip install pyinstrument

Pyinstrument... See more

When a test fails, you should be able to begin investigation with nothing more than the test’s name and its failure messages —no need to add more information and rerun the test.

Effective use of unit test frameworks and assertion libraries (JUnit, Truth, pytest, GoogleTest, etc.) serves two important purposes. Firstly, the more precisely we express... See more

Problem : Tight coupling leads to fragility - a change in one microservice breaks connected services.

Low cohesion results in unclear responsibilities.

• Solution : Apply loose coupling and high cohesion. In a loosely coupled system, each component is independent and changes in one will not affect the others. High cohesion means that each component

... See more

We ship early

We constantly review the scope of a project and work toward a v0, not a v1.

That means identifying the most crucial part of a functionality , and pushing the smallest pull request possible to make that happen. In fact, a PR should always be optimized for the speed with which we can merge it in.

The book Clean Code introduces three laws of TDD [1]:

1. Write a failing unit test first before you start writing production code.


2. Write not more of a unit test than is sufficient to fail.


3. Write not more production code than is sufficient to pass the currently failing test.

So, the tests are written before the production code. This leads to the developer... See more

" Knowledge is powerful, be careful how you use it! "

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools, and more.

Created by trimstray and contributors

📔 What is it?

This repository is a collection of various materials and tools that I use every day in my work. It contains a lot of useful information... See more