Cloud Applications

When talking about messaging and asynchronous data processing, it is very common you hear about the jargon “data stream”. Let us start with the basic question. What is a data stream? The data stream is nothing but data that is continuously generated by thousands of data sources, which typically send data records simultaneously for processing. […]

What is SNS? Amazon SNS is the abbreviation of the popular AWS service ‘simple notification service’. It is a managed publish/subscribe (also known as “pub/sub”) service from Amazon Web Services. Essentially with SNS, one can publish messages to ‘SNS topic’, which will be received by multiple subscribers at the same time. Publisher/Subscribe in simple terms […]

Asynchronous messaging We have point-to-point (1 to 1 message) and publisher-subscriber (1 to many messages) patterns typically used in messaging systems for async communication. Point-to-Point: the message is sent from one application(producer) to another application(consumer). Even if there are more consumers listening, one of them will get the message. Also, message delivery is guaranteed by […]

What is this ‘fanout’? Fanout is a common design pattern used in cloud applications, to take advantage of parallel processing. Parallel processing — example Let us see how OTT providers like Youtube, Netflix, and Amazon Prime use this pattern to save time in solving their important time-consuming tasks of video transcoding, optimized for different devices […]