From monolith to microservices – to migrate or not to migrate?

From monolith to microservices – to migrate or not to migrate?

Microservices is architectural style focused on speed of software development understood as number of functionalities created within time unit or duration of the whole delivery process – from the concept to deployment (time to market). The current high changeability of business environment fosters more and more popularity of microservice approach, which forces companies to react quickly in order to avoid the situation when a good solution, implemented too late, becomes a bad solution.

Most enterprise class systems, which are currently functioning, have monolithic architecture. Their indisputable advantage is of course the fact that they are working and providing income or savings to companies which have them. However, monolithic architecture causes that as the systems grow, the pace of their development gradually decreases. Business owners must wait longer for functionalities they have ordered. To make matters worse, scalability of software development process turns out to be far from linear. Engaging more people or teams to work on such systems generate less and less income. Introducing new employees takes more and more time, while present ones become discouraged and demand pay for harmful working conditions or start to ponder career path outside the organization. Such symptoms clearly indicate that system architecture has ceased to meet company’s requirements. Applying evolutionary architecture – microservices – is the best solution to an insufficient pace of system development issue.

To illustrate the effect of using microservice approach, we can use a certain metaphor. Let’s assume that we would like to build and maintain space station. In order to do that we will need to deliver various cargoes to an orbit, such as: people, materials, equipment etc. At present, the only available form of transport are space flights, which despite the latest achievements of such companies as SpaceX, are very expensive and require time-consuming preparation. Hence, we can try to come up with another solution – space elevator. Obviously, expenses for building it will be much higher than the cost of a single flight. However, each subsequent transport will be possible basically right away and free of charge (compared to flight costs).

The abovementioned metaphor, apart from illustrating the vision of the bright future, which microservices promise to us, allow us to come to another important conclusion. Namely, implementing such approach constitutes a huge challenge and requires significant investment. Therefore, before we start to build a space elevator we should make sure that we need to get to an orbit and will be going there frequently. Otherwise, the whole endeavor will merely be an art for the art’s sake.

Migrate or not to migrate?

Before making a decision about applying microservice approach, you should consider a few issues:

  • if the product (system) received market confirmation,
  • if the expected product development pace will require engaging more than one team (~10 people),
  • if the system has high requirements related to reliability and scalability or whether they are significantly differentiated between its elements?

The moment within the system life-cycle, during which the criteria will be fulfilled, is optimal for taking a decision about using microservice approach.

You should not forget that microservice approach has its own limits of usability – for instance, it should not be used in case of real time systems.

Microservice architecture

Widely acknowledged author of microservice architecture theory, Sam Newman, has come up with the following definition:

“small autonomous services modelled around business domain that work together

It turns out that the basic building blocks in this approach are the services which we will extract using decomposition by domain (business capability). These services can be developed and deployed independently, but they must cooperate in order to implement business process.

Service anatomy

If the component, which is the part of the system, merely stores data, then it is basically a database; if it contains only logic – it is called function. Service, in its assumption, comprises both these elements – logic and data. Such combination creates a foundation of autonomy to which Sam Newman draws attention to. It is worth to have the definition in mind while approaching the issue of system decomposition.

Division lines

Architectural styles differ from each other in the way they decompose a system into smaller components. The significant aspect of microservice architecture is organization of service functionalities around business capabilities, which allows to provide their high cohesion and stability of the estabilished division. Such method of harnessing the complexity of business logic was popularized by Eric Evans under the name of “Domain Driven Design”. It describes the way of dividing the domain into subdomains, and then designating bounded contexts within them which will be used as service boundaries.

Practical technique of identifying bounded contexts is “Event Storming” suggested by Alberto Brandolini. Its first step is about identifying events occurring in business domain. Such approach allows to direct modelling process to behavior instead of focusing it on static structure of the information processed. This seemingly subtle change of perspective is crucial for microservice architecture, because it enables developing system characterized by loose coupling and huge autonomy of its elemental services.

Setting the boundaries of services you should not forget that they will become boundaries of transactions and strong immediate consistency (ACID). For operations which involve several services, the system will provide BASE (Basically Available, Soft state, Eventual consistency) semantics, which offers the guarantee of liveness, but does not provide safety. Unlike ACID, BASE means that the system eventually will achieve consistency, however neither it is known how such state is going to look like, nor how the system will behave in the meantime. There is a possibility of achieving strong eventual consistency within BASE model, without traditional mechanisms of controlling concurrency. However, it requires using so called CRDT (conflict-free replicated data types).

Reality is not transactional. Not too often do users require immediate consistency. An example may be finance domain, which as it may seem, should have the highest consistency requirements. Nevertheless, we all got used to the fact that making interbank transfers takes hours or even days and we do not know what happens with funds during this operation – neither can we see it on source account nor on target one.

Many times software engineers themselves tend to force immediate consistency where it is unnecessary, and sometimes it may be even harmful. Once I came across large company management system. While granting the customer VIP status within CRM module, logistic subsystem automatically generated the order to ship a bottle of wine which was supposed to additionally emphasize distinction. The whole operation was performed during single transaction, which caused that at the moment of running out of champagne warehouse resources, an attempt to order shipment ended up with an error, the whole transaction was rolled back, and as a result you couldn’t set VIP status of the client. Dividing operations into two separate transactions and using saga pattern, in this case would be a better solution.

In conclusion, you should check what consistency guarantees are required for particular functionalities and make sure that established boundaries secure these requirements.

Preparation

Introducing microservice architecture carries a lot of challenges which should be discussed before transformation process starts. System designed this way will require automation of build, configuration, testing and deployment processes. Also tools for collecting and aggregating logs as well as metrics, and also behavior analysis (tracking, profiling etc.) within distributed environment will be crucial.

At the early stage of transformation process it is necessary to determine the way of integrating and coordinating services, data architecture, methods of providing transactional consistency and reliability, configuration, service discovery, as well as other cross-functional aspects. Introducing or changing these solutions during later transformation stages will be much more costly than at its beginning.

The issues mentioned above are so important and broad that they should be discussed in a separate article. Neglecting especially an area of integration may result in lack of service autonomy and cause that eventually instead of expected microservice architecture we will end up with distributed monolith.

Evolution or revolution?

Once we have set the service boundaries, which are going to act as target solution structure, we must decide how to carry out the transformation: whether are we going to renew the system step by step, gradually extracting subsequent components, or are we going to create the whole system from scratch and we will put it into service after the whole operation is completed. Second option is certainly much simpler and more tempting, however in most cases unacceptable. In conditions of strong competition and huge dynamics of the market, only few companies can allow themselves to suspend development of IT system – which their key business processes depend on – for a longer period of time. If, along with transformation of the architecture, we want to additionally change technology or key framework, then the first approach cannot be applied as well. In such a situation we may adopt an approach called strangler pattern.

Transformation

How can we perform gradual transformation to microservice architecture?

Let’s take the system with monolithic structure as a starting point for the process:

Monolith to Microservices

The first step is partial logical separation of user interface from service layer. Handling of the business logic commands is delegated to service layer, while queries, which support the views, are directed to the database. At the moment we are not modifying the database itself:

Monolith

The second step is a full logical separation of user’s interface:

MicroservicesIn third step you have to physically separate user’s interface, create API at backend’ side, and use it to communicate between these two components:

From Monolith to Microservices

The fourth step is about gradual extraction of subsequent services. This time we perform full separation – down to  the level of database. If organization had not used microservice architecture earlier, it would be good to start decomposing with domain which is small and easy to extract.  It will allow the team to gain necessary experience with little risk and in a relatively short time.

API Gateway

The last step is frontend decomposition, which we may also perform in stages – gradually extracting subsequent user interface elements:

Layout Service

An indisputable advantage of the this process is its evolutionary character. Thanks to it we may gradually change architecture, without full stopping system development, by adjusting the pace of changes to business requirements and available resources.

Context

System architecture does not drift in the void. It is strongly tied with production process and company’s structure and culture. The key feature of microservice architecture is its evolutionary character, which means that choosing this approach will bring the most benefits in company assembled from little autonomous teams using agile software development methodologies. However, lack of these features should not stop us from selecting this architecture. We may adopt them simultaneously with the process of changing the architecture, but we cannot completely ignore them. According to Conway law:

“…organizations which design systems … are constrained to produce designs which are copies of the communication structures of these organizations.”

Thus, if we introduce microservice approach in strongly centralized, hierarchical company, there is a risk that with time our system’s architecture will drift towards a monolith. That is why we should start transforming system architecture with so called Inversed Conway Maneuver that is developing organizational structure isomorphic with expected target system architecture. Once we remove traditional functional silos (frontend dev, backend dev, dba, qa, ops, etc), and we introduce cross-functional teams, focused around value streams and business capabilities instead, it will be much easier for us to decompose the system analogically, and then maintain obtained architecture.

“Design the organisation you want, the architecture will follow (kicking and screaming).”

Evan Bottcher, ThoughtWorks

Success criteria

Once we have completed transformation process, it is worth checking if we managed to get the assumed result. Whether what we achieved can be called a success. The goal of introducing microservice architecture is first of all to improve processes related to developing and improving software. We might measure it following a few simple indicators, for example:

  • duration of production cycle understood as average time from the concept to implementation (time to market);
  • performance of production process measured as average number of functionalities (user stories) provided by the team (or per team member) in time unit;
  • scalability of production process measured as change of performance of production process in function of team’s size and number of teams;
  • average time necessary to locate and remove failure (mean time to repair).

Comparing values of these characteristics for old and new architecture, we might evaluate the effect of transformation performed. The abovementioned indicators can also be monitored during transformation process.

Here, at Altkom Software & Consulting, as engineers, we are fascinated with solutions which allow us to improve the world around us. However, we are aware of the fact that each change is an investment which has to pay off.

Author: Robert Kuśmierek, Lead Software Engineer, ASC LAB