The Livepeer.com streaming API is powered by Livepeer, a network with uniquely distributed architectural design. At the core of this network is a live ingest and transcoding engine that tries to maintain a robust live streaming workflow in the face of networking issues or hardware failures. This helps the Livepeer.com infrastructure scale in unique ways.

In a simple live streaming setup, a broadcaster sends a video stream into a media server. The media server receives the stream, transcodes it into different renditions, packages it up into the delivery format, and sends it to the CDN edge. The video player loads from the edge and plays the video on the user’s device.

This system works well for a small number of concurrent streams. But as we start to scale this system, we will quickly run into performance bottlenecks with the media server and transcoding system – 

 for a live stream to reach a wide audience. As an example, a medium VM on AWS can only transcode 2-3 concurrent streams in a standard bitrate ladder (1080p, 720p, 480p, 360p, 240p). A common solution to this problem is to operate many media server instances and load balance between them. However, this creates another problem – transcoding processes can fail in the middle of a stream if the resources are not carefully managed. The difficult problem of dynamically spinning up and down servers and load balancing long running streams between them make the system brittle. Each small error can cause multiple streams to fail at the same time. Each failure can make the live streams buffer, drop frames, or even completely cut out.

Instead of having each stream handled by a single server, Livepeer takes a distributed approach for ingest and transcoding. Ingest servers create video segments based on incoming keyframe intervals, and each segment is sent to a network of distributed transcoding clusters.

The ingest server keeps track of the latency and performance of each transcoding cluster, so that it can switch to different clusters in the middle of a stream when performance starts to degrade. Since the ingest servers only need to worry about video ingestion and segmentation, they can be strategically placed in high bandwidth environments with geographic diversity, which optimizes for network connection with broadcasters and CDNs. Each ingest server can handle many concurrent streams, because it no longer needs to take on the computation burden of transcoding.

The transcoding cluster has layers of redundancy and failover, so that failures can be quickly retried within the cluster. These transcoding clusters can operate in a variety of different environments – professional data centers, cryptocurrency mining farms, gaming computers to list a few. Most of the current transcoders are GPU based, which reduces transcoding latency by an order of magnitude. Because of the low cost in these environments comparing to public cloud providers, transcoding jobs can even be done multiple times in parallel to ensure high success rate and low latency in the live stream. The Livepeer transcoding software is currently tuned to run in a multi-GPU environment, load balancing across 2-8 GPUs on the same machine. Depending on the types of GPUs, some machines can transcode over 100 concurrent video streams. If internet congestion happens in a certain region, with a specific ISP, or DNS provider, other transcoder clusters will seamlessly pick up the work from the ones that are impacted by the outage. All of this can happen without central coordination, since the ingest servers and transcoders are all making independent routing decisions.

The distributed architecture also poses unique and interesting engineering challenges. For example, when each segment is processed independently, it's challenging for the system to have stream awareness and ensure consistent segment lengths, GOP sizes, and other video format specific configurations. The ingest server / transcoder communication should have proper back-pressure built in, so the performance degradation happens gracefully instead of abruptly. There should also be proper retry policy in place, so a DDoS attacker cannot bring down the whole infrastructure through amplified retries caused by transcoding errors. Livepeer is working on solutions that can address issues like this in both a controlled environment and a decentralized environment where a part of the infrastructure is operated by third-party operators.

Livepeer is a decentralized network, and the operation of the nodes that make up the network depends on independent node operators. In order to maintain baseline capacity to regions of the world with high demand, Livepeer operates a portion of the network. The deployment is on top of a heterogeneous environment, ranging from bare metal servers to Kubernetes namespaces. We use tools like Kubernetes, Ansible, and Consul to manage our deployment. This allows us to gain more control in resource management and automatically recover from hardware/software failures. 

Live streaming on the internet is a difficult task because users demand for 100% reliability, and the internet is not a very stable environment. Livepeer uses robust software with "cheap and fast" hardware to help us with the goal of achieving high reliability, while keeping the cost low. We are constantly improving our 

, and we would love to hear your feedback. If you are interested in learning more about Livepeer, please check out the 

. If you are interested in working on Livepeer, please take a look at the 

"senior video infrastructure engineer" position

"senior software engineer - public network" position.

How to Analyze Livepeer Video Engagement Metrics with Timeplus

 Lenstube offers video on demand for both long-form and short-form videos

web3 social platform for video sharing built on Lens Protocol

 is a web3 social platform for video sharing that combines the best of traditional video-sharing platforms with the latest web3 functionalities. Whether you're a professional creator or an amateur, Lenstube gives you the ability to upload and monetize your video content with ease. Currently, Lenstube offers video on demand for both long-form videos and short-form videos.

Lenstube sets itself apart from traditional video-sharing platforms by incorporating web3 features such as connecting to a crypto wallet, enabling creators to receive tips in MATIC coins, collecting videos as NFTs, and charging membership fees for subscribers. These features are made possible through Lenstube's implementation of various web3 technologies, including Livepeer, Arweave, IPFS, and Lens. By utilizing decentralized technologies, Lenstube is revolutionizing the way creators can share and monetize their content, and provides a new and exciting way to engage with their audience.

 founded Lenstube with the goal of creating a decentralized video sharing platform for content creators. The idea for Lenstube came about after Sasi saw some of his favorite creators, who were creating and teaching web3, being unjustly removed from traditional web2 platforms. This led Sasi to understand the importance of web3 for content creators, and the significance of permanent data storage and content ownership. With this in mind, Sasi set out to create his own web3 video-sharing platform. The first step in this process was to find a video-on-demand service that transcodes and serves video from Arweave.

“I knew that creating a video delivery infrastructure and transcoding videos would be a significant challenge, and I definitely didn't want to spend all my time and resources on these technicalities, especially in the early stages of development. Luckily, I discovered Livepeer on the sponsor list of one of the EthGlobal hackathons. Livepeer provided exactly what I needed to move Lenstube forward, and integrating it into my platform was one the first, and easiest, decisions I made.”

Lenstube's partnership with Livepeer has been a vital component of the platform's success. Currently, all videos on Lenstube, whether they are long or short form, are powered by Livepeer. This means that Livepeer handles all the technical aspects of video delivery, such as ingesting, processing, and transcoding. This has afforded Sasi and the Lenstube team the freedom to focus on other important growth areas, like attracting new creators to the platform and improving user experience.

“Working with Livepeer has definitely been a great experience, and we receive tons of support from the team. Recently, Livepeer launched a feature that displays view counts beneath the video player. We were able to implement this feature pretty quickly, and the team was available to answer any questions we had. Although, most of the time we don’t really need the support, as the guides and docs for the Livepeer SDK and API are awesome.”

Today, Lenstube is thriving and making significant strides in its development. The platform has reached notable milestones, such as surpassing 10,000 video uploads in December 2022, averaging more than 1,000 daily sessions, and reaching more than 50,000 average monthly users in January 2023. These milestones demonstrate the effectiveness of the Lenstube team's efforts and the growing appeal of the platform among content creators and viewers alike.

Lenstube boasts a user-friendly interface that includes all of the features commonly found on traditional web2 video sharing platforms. The front page prominently showcases the most recent and popular short-form (Bytes) and long-form videos hosted on the platform, which can be filtered by video category for easy browsing. Users can log in with their Lens handle on the top right corner of the page. Additionally, various exploration tools can be found on the left-hand menu bar for easy access.

Bytes are short-form, vertical videos that are similar to TikToks and YouTube Shorts. Users can scroll through a feed, like and dislike videos, subscribe to channels, and share Bytes via URL or embed videos directly on websites. Additionally, Bytes can be easily shared on Lenster, Twitter, Reddit, and LinkedIn.

Sasi and the Lenstube team have recently made a concerted effort to develop the Bytes feature. This effort was motivated by the increasing popularity of short-form videos on web2 platforms. Not only do short videos have high user retention rates, but they also provide creators with an effective way to capture an audience and lead them to content on other platforms.

“In my opinion, short-form videos are one of the most effective ways to share content with a wide audience, and they offer creators greater opportunities for engagement. We predict that the use of short-form videos as NFTs will become a popular trend in the web3 community."

Do you want to build your own web3 short-form video app? Disrupt TikTok with this 

 walking through the key components of building a social app with quick, bite-sized video.

Lenstube also enables creators to upload long-form, horizontal videos that are similar to standard YouTube videos. In addition to features found on Bytes, these long-form videos also include view counts, video descriptions, and a comment section.

Every video hosted on Lenstube is equipped with a variety of web3 features. These features not only enable content creators to earn revenue from their videos, but also provide fans with a way to support their favorite creators. This is what sets Lenstube apart from traditional web2 video sharing platforms. Some of the web3 features that Lenstube offers include:

Mirroring across Lens, with custom referral fees

Default sharing of all Lenstube videos across Lens ecosystem apps

Lenstube’s frontend was built using Next.Js, an open-source React framework for web applications. Lenstube uses Apollo Client to manage local and remote data, and to fetch data and do mutations through the Lens Protocol’s GraphQL backend.

Middleware is like a “software glue” that acts as a bridge between different technologies, tools, and databases so they can be integrated into a single system. Lenstube uses Lens Protocol’s indexer for its middleware, and this indexer streamlines data between Lens contracts and viewers. The Lens indexer is a GraphQL server that listens to events from Lens contracts and stores the data into a database. This indexer enables viewers to quickly and efficiently access video data, which leads to a better user experience.

Lenstube’s backend consists of four main components: Livepeer, Arweave, IPFS, and Lens

Lenstube uses Livepeer to process and play back video. Livepeer is a protocol built on Ethereum that distributes video transcoding work throughout its decentralized network. The protocol provides cost efficient, secure, and reliable infrastructure. Livepeer's mainnet launch took place in 2018 and the network now processes millions of minutes of video each week.

Lenstube stores its video files on Arweave and IPFS, web3 protocols that offer data storage on decentralized networks. Arweave and IPFS offer permanent and immutable data storage, and anyone can store data in the networks or offer storage space, without there being a centralized point of failure.

Lenstube uses Lens for its social graph. The Lens social graph is fully composable, open source, and decentralized. This helps transfer full rights and complete ownership of content into the hands of creators.

Sasi intends to improve the Lenstube platform by adding new features, with the primary objective of providing exceptional user experience and boosting user engagement on the platform. Furthermore, Sasi is currently building a mobile application that specifically caters to short-form videos, which will be released soon. This further solidifies his belief that short-form videos represent a rapidly expanding area in the video industry and is positioning Lenstube to capitalize on this growth potential.

If you’re a developer that would like to build your own web3 video app, check out these 

 to get started. If you have any questions about building, 

Lenstube is a web3 social platform for video sharing that combines the best of traditional video-sharing platforms with the latest web3 functionalities. Whether you're a professional creator or an amateur, Lenstube gives you the ability to upload and monetize your video content with ease. Currently, Lenstube offers video on demand for both long-form videos and short-form videos.

Scaling the Livepeer Network