Cloud Engineering – Software Engineering Daily

By Cloud Engineering – Software Engineering Daily

Listen to a podcast, please open Podcast Republic app. Available on Google Play Store.


Category: Software How-To

Open in iTunes


Open RSS feed


Open Website


Rate for this podcast

Subscribers: 130
Reviews: 0

Description

Episodes about building and scaling large software projects

Episode Date
Service Mesh Deployment with Varun Talwar
50:05

The service mesh abstraction allows for a consistent model for managing and monitoring the different components of a microservices architecture.  In the service mesh pattern, each service is deployed with a sidecar container that contains a service proxy. These sidecars are collectively referred to as the “data plane.” Each sidecar provides the service that it

The post Service Mesh Deployment with Varun Talwar appeared first on Software Engineering Daily.

Aug 14, 2019
gVisor Container Isolation with Michael Pratt and Yoshi Tamura
56:53

Software applications running within a host operating system need to be isolated. Isolation prevents security vulnerabilities, such as one application accessing the memory of another. In modern cloud environments, a single physical host might be running multiple virtual machines on top of a hypervisor. Those virtual machines might be divided up into containers. The different

The post gVisor Container Isolation with Michael Pratt and Yoshi Tamura appeared first on Software Engineering Daily.

Jul 10, 2019
Infrastructure Wars with Sheng Liang
1:01:59

Sheng Liang was the lead developer on the original Java Virtual Machine. Today he works as the CEO of Rancher Labs, a company building a platform on top of Kubernetes. Sheng joins the show to discuss his experiences in the technology industry. The container orchestration wars had many victims. The competing standards for how an

The post Infrastructure Wars with Sheng Liang appeared first on Software Engineering Daily.

Jun 19, 2019
Kubernetes Operators with Rob Szumski
1:09:07

Kubernetes has made distributed systems easier to deploy and manage. As Kubernetes has become reliable, engineers have started to look for higher level abstractions we can define on top of Kubernetes. An operator is a method of packaging, deploying, and managing a Kubernetes application. Operators are useful for spinning up distributed systems such as Kafka,

The post Kubernetes Operators with Rob Szumski appeared first on Software Engineering Daily.

Jun 18, 2019
Render: High Level Cloud with Anurag Goel
1:20:30

Cloud computing was popularized in 2006 with the launch of Amazon Web Services. AWS allowed developers to use remote server infrastructure with a simple set of APIs. But even with AWS, it was still not simple to deploy and manage a web application. In 2007, Heroku launched a platform built on top of AWS. Heroku

The post Render: High Level Cloud with Anurag Goel appeared first on Software Engineering Daily.

Jun 17, 2019
Kubernetes Vision with Joe Beda
1:12:18

Google Cloud was started with a vision of providing Google infrastructure to the masses. In 2008, it was not obvious that Google should become a cloud provider. Amazon Web Services was finding success among startups who needed on-demand infrastructure, but the traditional enterprise market was not yet ready to buy cloud resources. Googlers liked the

The post Kubernetes Vision with Joe Beda appeared first on Software Engineering Daily.

Jun 11, 2019
Kubernetes Storage with Saad Ali
1:00:30

Containers are made to fail gracefully. When your container shuts down due to a hardware or software failure, your distributed application should be able to tolerate that failure. One simple way to be able to tolerate such a failure is to make all of your application logic “stateless.” If your application does not maintain state,

The post Kubernetes Storage with Saad Ali appeared first on Software Engineering Daily.

Jun 10, 2019
Kubernetes Market with Adam Glick
1:18:41

Amazon Web Services is the leading cloud provider by a large margin. Amazon established its lead by being first to market in 2006, with Google and Microsoft taking several years to catch up to the huge business opportunity of the cloud. Since 2008, Google Cloud has been working on cloud products for developers. It started

The post Kubernetes Market with Adam Glick appeared first on Software Engineering Daily.

Jun 07, 2019
Service Mesh Interface with Lachlan Evenson
1:05:01

Containers offer a lightweight abstraction for running a server. Cloud providers are able to manage billions of containers from different users, allowing for economies of scale so that each user can pay less. Today, there is a variety of ways that users can deploy containers on a cloud provider. These containers can run in managed

The post Service Mesh Interface with Lachlan Evenson appeared first on Software Engineering Daily.

Jun 06, 2019
Multicloud Future with Bassam Tabbara
1:10:46

Each cloud provider offers a different set of services which are not always compatible with each other. What are the challenges of building an application that interoperates with multiple different clouds? The first issue is API compatibility. Most cloud providers have a managed SQL offering, a bucket storage system, and server abstractions like virtual machines

The post Multicloud Future with Bassam Tabbara appeared first on Software Engineering Daily.

Jun 05, 2019
Kubernetes Development with Tim Hockin
50:55

Kubernetes has evolved from a nascent project within Google to a thriving ecosystem of cloud providers, open source projects, and engineers. Tim Hockin is a principal software engineer who has been with Google for 15 years. Tim joins the show to talk about the early days of the Kubernetes projects, and the engineering efforts that

The post Kubernetes Development with Tim Hockin appeared first on Software Engineering Daily.

Jun 04, 2019
Google Anthos with Aparna Sinha
57:18

Google’s cloud business was long regarded as a place where startups could build a business, but not established enterprises. For serious workloads, enterprises chose Amazon almost unanimously. This phenomenon of Amazon as the default was described by a phrase that harkened back to the days of IBM’s dominance: “nobody ever got fired for choosing AWS.”

The post Google Anthos with Aparna Sinha appeared first on Software Engineering Daily.

Jun 03, 2019
Service Mesh Wars with William Morgan
1:21:11

A service mesh is an abstraction that provides traffic routing, policy management, and telemetry for a distributed application. A service mesh consists of a data plane and a control plane. In the data plane, a proxy runs alongside each service, with every request from a service being routed through the proxy. In the control plane,

The post Service Mesh Wars with William Morgan appeared first on Software Engineering Daily.

May 31, 2019
Netflix Early Days with Greg Burrell
1:05:13

Netflix started with a DVD-by-mail product. The software infrastructure and operations practices needed for the DVD business were very different from those needed by a streaming video company. Since the early days of Netflix, CEO Reed Hastings knew that the company would evolve to becoming a streaming video platform. But he did not know when

The post Netflix Early Days with Greg Burrell appeared first on Software Engineering Daily.

May 29, 2019
Scaling Intuit with Alex Balazs
1:01:35

Alex Balazs is the Intuit Chief Architect and has been working at the company for almost twenty years. Intuit’s products include QuickBooks, TurboTax, and Mint. These applications are used to file taxes, manage business invoices, conduct personal accounting, and other critical aspects of a user’s financial life. Because the applications are managing money for users,

The post Scaling Intuit with Alex Balazs appeared first on Software Engineering Daily.

May 21, 2019
Kubernetes Virtualization with Paul Czarkowski
56:55

Modern server infrastructure usually runs in a virtualized environment. Virtual servers can exist inside of a container or inside of a virtual machine. Containers can also run on virtual machines. Kubernetes has allowed developers to manage their multiple containers, whether those containers are running in VMs or on bare metal (servers without VMs). As organizations

The post Kubernetes Virtualization with Paul Czarkowski appeared first on Software Engineering Daily.

May 07, 2019
Cloud with Eric Brewer
1:04:19

RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the

The post Cloud with Eric Brewer appeared first on Software Engineering Daily.

Apr 26, 2019
Intricately: Mapping the Internet with Fima Leshinsky
1:03:57

RECENT UPDATES: FindCollabs is a company I started recently The FindCollabs Podcast is out! FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a set of SE Daily hoodies, respectively). The most valuable feedback award and the

The post Intricately: Mapping the Internet with Fima Leshinsky appeared first on Software Engineering Daily.

Apr 25, 2019
gVisor: Secure Container Sandbox with Yoshi Tamura
50:04

RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a

The post gVisor: Secure Container Sandbox with Yoshi Tamura appeared first on Software Engineering Daily.

Apr 24, 2019
Observability Engineering with James Burns
1:02:26

RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a

The post Observability Engineering with James Burns appeared first on Software Engineering Daily.

Apr 23, 2019
Serverless Runtimes with Steren Giannini
57:26

RECENT UPDATES: Podsheets is our open source set of tools for managing podcasts and podcast businesses New version of Software Daily, our app and ad-free subscription service FindCollabs is hiring a React developer FindCollabs Hackathon #1 has ended! Congrats to ARhythm, Kitspace, and Rivaly for winning 1st, 2nd, and 3rd place ($4,000, $1000, and a

The post Serverless Runtimes with Steren Giannini appeared first on Software Engineering Daily.

Apr 22, 2019
AWS Storage with Kevin Miller
55:17

RECENT UPDATES: FindCollabs $5000 Hackathon Ends Saturday April 15th, 2019 New version of Software Daily, our app and ad-free subscription service Software Daily is looking for help with Android engineering, QA, machine learning, and more   A software application requires compute and storage. Both compute and storage have been abstracted into cloud tools that can

The post AWS Storage with Kevin Miller appeared first on Software Engineering Daily.

Apr 08, 2019
AWS Compute with Deepak Singh
58:13

Upcoming event: FindCollabs Hackathon at App Academy on April 6, 2019 On Amazon Web Services, there are many ways to run an application on a single node. The first compute option on AWS was the EC2 virtual server instance. But EC2 is a large abstraction compared to what many people need for their nodes–which is

The post AWS Compute with Deepak Singh appeared first on Software Engineering Daily.

Apr 05, 2019
Uber Infrastructure with Prashant Varanasi and Akshay Shah
1:02:29

Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Uber’s infrastructure supports millions of riders and billions of dollars in transactions. Uber has high throughput and high availability requirements, because users depend on the service for their day-to-day transportation. When Uber was

The post Uber Infrastructure with Prashant Varanasi and Akshay Shah appeared first on Software Engineering Daily.

Apr 01, 2019
Workload Scheduling with Brian Grant
50:18

Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google has been building large-scale scheduling systems for more than fifteen years. Google Borg was started around 2003, giving engineers at Google a unified platform to issue long-lived service workloads as well as

The post Workload Scheduling with Brian Grant appeared first on Software Engineering Daily.

Mar 29, 2019
Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal
56:54

Upcoming events: A Conversation with Haseeb Qureshi at Cloudflare on April 3, 2019 FindCollabs Hackathon at App Academy on April 6, 2019 Google’s Borg system is a cluster manager that powers the applications running across Google’s massive infrastructure. Borg provided inspiration for open source tools like Apache Mesos and Kubernetes. Over the last decade, some

The post Peloton: Uber’s Cluster Scheduler with Min Cai and Mayank Bansal appeared first on Software Engineering Daily.

Mar 28, 2019
Netlify with Mathias Biilmann Christensen
1:02:25

Cloud computing started to become popular in 2006 with the release of Amazon EC2, a system for deploying applications to virtual machines sitting on remote data center infrastructure . With cloud computing, application developers no longer needed to purchase expensive server hardware. Creating an application for the Internet became easier, cheaper, and simpler. As the

The post Netlify with Mathias Biilmann Christensen appeared first on Software Engineering Daily.

Mar 08, 2019
Kubernetes Security with Liz Rice
54:36

A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the security settings on your etcd, your API server, and your container

The post Kubernetes Security with Liz Rice appeared first on Software Engineering Daily.

Feb 14, 2019
Replicated: On-Prem Deployments with Grant Miller
1:03:06

Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The shorthand term for this software environment is “on-prem”. Deploying software to your own on-prem servers

The post Replicated: On-Prem Deployments with Grant Miller appeared first on Software Engineering Daily.

Feb 13, 2019
Knative: Serverless Workloads with Ville Aikas
59:08

Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized the container orchestration layer and created a thriving community. The Kubernetes community gives the cloud providers a neutral ground to collaborate on projects that benefit

The post Knative: Serverless Workloads with Ville Aikas appeared first on Software Engineering Daily.

Feb 08, 2019
VMware Kubernetes Strategy with Brad Meiseles
51:07

Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools for allowing enterprises to deploy virtual machines throughout their organization. Containers provide another improvement to server utilization. A virtual machine can be

The post VMware Kubernetes Strategy with Brad Meiseles appeared first on Software Engineering Daily.

Feb 07, 2019
Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto
58:04

HashiCorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too hard: there was a need for new tools to serve application developers. Hashicorp founders Mitchell Hashimoto and Armon Dadgar began releasing

The post Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto appeared first on Software Engineering Daily.

Feb 04, 2019
Prometheus Scalability with Bryan Boreham
53:24

Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely used by large distributed systems deployments such as Kubernetes and Cloud Foundry. Prometheus gathers metrics from your services by

The post Prometheus Scalability with Bryan Boreham appeared first on Software Engineering Daily.

Jan 21, 2019
Spot Instances with Amiram Shachar
1:05:40

When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get started on. New applications with few users can often be hosted

The post Spot Instances with Amiram Shachar appeared first on Software Engineering Daily.

Jan 18, 2019
Kubernetes in China with Dan Kohn
59:21

Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon. JD.com, a Chinese ecommerce company, has perhaps the largest production Kubernetes installation

The post Kubernetes in China with Dan Kohn appeared first on Software Engineering Daily.

Jan 14, 2019
AWS Analysis with Corey Quinn
1:06:09

Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for building applications. For the first few years of AWS, the abstractions were familiar. S3 provided

The post AWS Analysis with Corey Quinn appeared first on Software Engineering Daily.

Jan 11, 2019
Zeit: Serverless Cloud with Guillermo Rauch
1:11:03

Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing with IP addresses and configuring instances of their different services to be able to scale. Just as

The post Zeit: Serverless Cloud with Guillermo Rauch appeared first on Software Engineering Daily.

Jan 10, 2019
Cloud Events with Doug Davis
54:15

Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers that function. An “event” can mean many different things. It is a signal that something has

The post Cloud Events with Doug Davis appeared first on Software Engineering Daily.

Jan 09, 2019
Multicloud with Ben Hindman
1:12:42

Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying to a cloud provider tend to stay within that specific cloud provider, because moving between different clouds and

The post Multicloud with Ben Hindman appeared first on Software Engineering Daily.

Jan 08, 2019
Stateful Kubernetes with Saad Ali
1:00:08

In a cloud infrastructure environment, failures happen regularly. The servers can fail, the network can fail, and software bugs can crash your software unexpectedly. The amount of failures that can occur in cloud infrastructure is one reason why storage is often separated from application logic. A developer can launch multiple instances of their application, with

The post Stateful Kubernetes with Saad Ali appeared first on Software Engineering Daily.

Jan 07, 2019
Crossplane: Multicloud Control Plane with Bassam Tabbara
58:37

Cloud providers created the ability for developers to easily deploy their applications to servers on data centers. In the early days of the cloud, most of the code that a developer wrote for their application could run on any cloud provider, whether it was Amazon, Google, or Microsoft. These cloud providers were giving developers the

The post Crossplane: Multicloud Control Plane with Bassam Tabbara appeared first on Software Engineering Daily.

Jan 02, 2019
Google Early Days with John Looney Holiday Repeat
1:11:02

Originally posted on 16 June 2017. John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on Google from one distributed file system to another. In this episode, John

The post Google Early Days with John Looney Holiday Repeat appeared first on Software Engineering Daily.

Dec 25, 2018
Service Proxying with Matt Klein Holiday Repeat
56:18

Originally posted on 14 February 2017. Most tech companies are moving toward a highly distributed microservices architecture. In this architecture, services are decoupled from each other and communicate with a common service language, often JSON over HTTP. This provides some standardization, but these companies are finding that more standardization would come in handy. At the

The post Service Proxying with Matt Klein Holiday Repeat appeared first on Software Engineering Daily.

Dec 24, 2018
Linkerd Service Mesh with William Morgan
1:00:22

Software products are distributed across more and more servers as they grow. With the proliferation of cloud providers like AWS, these large infrastructure deployments have become much easier to create. With the maturity of Kubernetes, these distributed applications are more reliable. Developers and operators can use a service mesh to manage the interactions between services

The post Linkerd Service Mesh with William Morgan appeared first on Software Engineering Daily.

Dec 19, 2018
On-Prem Cloud with Bob Fraser
1:00:49

Not every company wants to move to the public cloud. Some companies have already built data centers, and can continue to operate their business with their own servers. Some companies have compliance issues with the public cloud, and want to operate their own servers to avoid legal risk. Operating a data center is not easy.

The post On-Prem Cloud with Bob Fraser appeared first on Software Engineering Daily.

Dec 03, 2018
Cloud Costs with Ran Rothschild
57:52

Cloud computing changed the economics of running a software company. Before the cloud, a software company had to purchase physical machines which often required thousands of dollars paid up front. The cloud allowed developers to deploy their applications for free, to operate a business for cheap, and to scale without hiring a dedicated team to

The post Cloud Costs with Ran Rothschild appeared first on Software Engineering Daily.

Nov 29, 2018
Schedulers with Adrian Cockcroft Holiday Repeat
58:08

Originally published on July 6, 2016. Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean scheduling Hadoop jobs or other workflows that require the orchestration of a network

The post Schedulers with Adrian Cockcroft Holiday Repeat appeared first on Software Engineering Daily.

Nov 19, 2018
Liquid Software with Baruch Sadogursky
59:40

The software release process is a barrier between written code and a live production environment that affects users. A software release process can involve a variety of different practices. Code might be tested for bugs using automation and manual testing. Static analysis tools can look at the code for potential memory leaks. A software release

The post Liquid Software with Baruch Sadogursky appeared first on Software Engineering Daily.

Nov 15, 2018
Fission: Serverless on Kubernetes with Soam Vasani
1:03:05

Serverless computing abstracts away the idea of a server node. Serverless lets programmers treat compute resources as high-level, reliable APIs, rather than unreliable, low-level compute nodes that might fail. Serverless dramatically improves the efficiency of programmers. Instead of thinking of a database as a set of servers that need to be sharded and replicated, the

The post Fission: Serverless on Kubernetes with Soam Vasani appeared first on Software Engineering Daily.

Nov 13, 2018
Scaling Lyft with Matt Klein
57:47

Matt Klein has worked for three rapidly growing Internet companies. At AWS, he worked on EC2, the compute-as-a-service product that powers a large percentage of the Internet. At Twitter, he helped scale the infrastructure in the chaotic days before Twitter’s IPO. Today he works at Lyft, building systems to allow for ride sharing infrastructure to

The post Scaling Lyft with Matt Klein appeared first on Software Engineering Daily.

Nov 02, 2018
Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis
52:16

A smart security camera takes in a high volume of video images and processes those images using a set of machine learning models. Those models can be used to identify interesting snippets of movement throughout the day, and decide which of those snippets to keep. Some of the video snippets might contain movement of birds–but

The post Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis appeared first on Software Engineering Daily.

Oct 25, 2018
DevSecOps with Edward Thomson
55:29

DevSecOps emphasizes moving security out of a siloed audit process and distributing security practices throughout the software supply chain. In the past, software development usually followed a waterfall development process. Each step in building software was serialized, one after another. First, software was planned. Then it was built. Then it was tested. Finally, the software

The post DevSecOps with Edward Thomson appeared first on Software Engineering Daily.

Oct 23, 2018
AWS Containers with Deepak Singh
52:55

Deepak Singh is the director of compute services at AWS, where he works on cloud products relating to containers, Linux, and High Performance Computing. In today’s show, Deepak describes how the market for containers and serverless has evolved, and how Amazon thinks about product strategy. Back in 2014, Docker containers were becoming a popular way

The post AWS Containers with Deepak Singh appeared first on Software Engineering Daily.

Oct 19, 2018
DevOps at Microsoft with Martin Woodward
1:04:56

The Windows operating system is one of the most widely used pieces of software in history. Windows was started before there was any alternative to a monolithic codebase, because Microsoft was building software before the Internet was widely used by consumers. Networked computers gave rise to web applications, and software engineers began to rethink how

The post DevOps at Microsoft with Martin Woodward appeared first on Software Engineering Daily.

Oct 12, 2018
Android Things with Wayne Piekarski
1:02:01

Internet of Things is a concept that describes lots of devices that you interact with regularly being connected to the Internet and networked together. Technologists have been dreaming of the world of IoT for many years, where our connected refrigerator can detect that we are out of food, and automatically order more food. Or our

The post Android Things with Wayne Piekarski appeared first on Software Engineering Daily.

Sep 27, 2018
Unity and WebAssembly with Brett Bibby
1:08:16

Unity is a game engine for building 2-D and 3-D experiences, augmented reality, movies, and other applications. Unity is cross-platform, so that applications can be written once and deployed to iOS, Android, web, and other surfaces. Unity has been around for 13 years, and has grown in popularity with the rise in gaming and game

The post Unity and WebAssembly with Brett Bibby appeared first on Software Engineering Daily.

Sep 25, 2018
Front Engineering with Laurent Perrin
53:55

Front is a shared inbox application that has seen rapid adoption within companies. Front allows multiple members of a company to collaborate together on a conversation–whether that conversation is in email, Twitter, or Facebook Messenger. This is useful when a customer email needs to be shared between the sales and engineering teams, or when a

The post Front Engineering with Laurent Perrin appeared first on Software Engineering Daily.

Sep 24, 2018
Android on Chrome with Shahid Hussain and Stefan Kuhne
54:35

Google has two consumer operating systems: Android and Chrome. The Android operating system has been widely deployed on mobile devices. Chrome is an operating system for laptops and tablets, originally based around the Chrome browser. For several years, these two ecosystems were mostly separate–you could not run Android apps on a Chrome operating system. Shahid

The post Android on Chrome with Shahid Hussain and Stefan Kuhne appeared first on Software Engineering Daily.

Sep 20, 2018
Kubernetes Distributions with Brian Gracely and Michael Hausenblas
1:03:32

Kubernetes is an open source container management system. Kubernetes is sometimes described as “the Linux of distributed systems” and this description makes sense: the large numbers of users and contributors in the Kubernetes community is comparable to the volume of Linux adopters in its early days. There are many different distributions of Linux: Ubuntu, Red

The post Kubernetes Distributions with Brian Gracely and Michael Hausenblas appeared first on Software Engineering Daily.

Sep 19, 2018
Continuous Delivery Pipelines with Abel Wang
49:38

Continuous integration and delivery allows teams to move faster by allowing developers to ship code independently of each other. A multi-stage CD pipeline might consist of development, staging, testing, and production. At each of these stages, a new piece of code undergoes additional tests, so that when the code finally makes it to production, the

The post Continuous Delivery Pipelines with Abel Wang appeared first on Software Engineering Daily.

Sep 18, 2018
Orchestrating Kubernetes with Chris Gaun
59:15

A company runs a variety of distributed systems applications such as Hadoop for batch processing jobs, Spark for data science, and Kubernetes for container management. These distributed systems tools can run on-prem, in a cloud provider, or in a hybrid system that uses on-prem and cloud infrastructure. Some enterprises use VMs, some use bare metal,

The post Orchestrating Kubernetes with Chris Gaun appeared first on Software Engineering Daily.

Sep 13, 2018
Kubernetes Continuous Deployment with Sheroy Marker
54:16

Engineering organizations can operate more efficiently by working with a continuous integration and continuous deployment workflow. Continuous integration is the process of automatically building and deploying code that gets pushed to a remote repository. Continuous deployment is the process of moving that code through a pipeline of environments, from dev to test to production. At

The post Kubernetes Continuous Deployment with Sheroy Marker appeared first on Software Engineering Daily.

Sep 10, 2018
Kubernetes Impact with Clayton Coleman
1:11:26

Kubernetes is in production clusters around the world with hundreds of thousands of containers. Kubernetes provides a distributed systems management environment for small startups and giant enterprises with applications ranging from microservices to machine learning pipelines. Because the use cases are already so wide-ranging, and the project has had so much adoption, the focus of

The post Kubernetes Impact with Clayton Coleman appeared first on Software Engineering Daily.

Aug 30, 2018
Android Slices with Jason Monk
57:15

The main user interfaces today are the smartphone, the laptop, and the desktop computer. Some people today interact with voice interfaces, augmented reality, virtual reality, and automotive computer screens like the Tesla. In the future, these other interfaces will become more common. Developers will want to be able to expose their applications to these new

The post Android Slices with Jason Monk appeared first on Software Engineering Daily.

Aug 28, 2018
Helm with Michelle Noorali
57:18

Back in 2014, platform-as-a-service was becoming an increasingly popular idea. The idea of PaaS was to sit on top of infrastructure-as-a-service providers like Azure, AWS, or Google Cloud, and simplify some of the complexity of these infrastructure providers. Heroku had built a successful businesses from the idea of platform-as-a-service, and there was a widely held

The post Helm with Michelle Noorali appeared first on Software Engineering Daily.

Aug 27, 2018
Build Faster with Nader Dabit
1:07:06

Building software today is much faster than it was just a few years ago. The tools are higher level, and abstract away tasks that would have required months of development. Much of a developer’s time used to be spent optimizing databases, load balancers, and queueing systems in order to be able to handle the load

The post Build Faster with Nader Dabit appeared first on Software Engineering Daily.

Aug 24, 2018
OLIO: Food Sharing with Lloyd Watkin
46:52

Food gets thrown away from restaurants, homes, catering companies, and any other place with a kitchen. Most of this food gets thrown away when it is still edible, and could provide nutrition to someone who is hungry. Just like Airbnb makes use of excess living capacity, OLIO was started to connect excess food with people

The post OLIO: Food Sharing with Lloyd Watkin appeared first on Software Engineering Daily.

Aug 21, 2018
Infrastructure Monitoring with Mark Carter
56:17

At Google, the job of a site reliability engineer involves building tools to automate infrastructure operations. If a server crashes, there is automation in place to create a new server. If a service starts to receive a high load of traffic, there is automation in place to scale up the instances of that service. In

The post Infrastructure Monitoring with Mark Carter appeared first on Software Engineering Daily.

Aug 14, 2018
GitOps: Kubernetes Continuous Delivery with Alexis Richardson
48:40

Continuous delivery is a way of releasing software without requiring software engineers to synchronize during a release.  Over the last decade, continuous delivery workflows have evolved as the tools have changed. Jenkins was one of the first continuous delivery tools and is still in heavy use today. Netflix’s open sourced Spinnaker has also been widely

The post GitOps: Kubernetes Continuous Delivery with Alexis Richardson appeared first on Software Engineering Daily.

Aug 13, 2018
Klarna Engineering with Marcus Granström
51:44

Klarna is a payments company headquartered in Sweden. Since being established in 2005 it has grown to handling $21 billion in online sales in 2017. Roughly 40% of all e-commerce sales in Sweden go through Klarna. Klarna’s original differentiator was that it allowed users to checkout of e-commerce stores without entering in credit card information.

The post Klarna Engineering with Marcus Granström appeared first on Software Engineering Daily.

Aug 10, 2018
Stripe Engineering with Raylene Yung
48:23

Stripe is a payments API that allows merchants to transact online. Since the creation of the payments API, Stripe has expanded into adjacent services such as fraud detection, business management, and billing. These other verticals leverage the existing customer base and infrastructure that Stripe has developed from the success of their payments business. Raylene Yung

The post Stripe Engineering with Raylene Yung appeared first on Software Engineering Daily.

Aug 09, 2018
GraalVM with Thomas Wuerthinger
56:09

Java programs compile into Java bytecode. Java bytecode executes in the Java Virtual Machine, a runtime environment that compiles that bytecode further into machine code, and optimizes the runtime by identifying “hot” code paths and keeping those hot code paths executing quickly. The Java Virtual Machine is a popular platform for building languages on top

The post GraalVM with Thomas Wuerthinger appeared first on Software Engineering Daily.

Aug 03, 2018
Edge Kubernetes with Venkat Yalla
57:43

“Edge computing” is a term used to define computation that takes place in an environment outside of a data center. Edge computing is a broad term. Your smartphone is an edge device. A self-driving car is an edge device. A security camera with a computer chip is an edge device. These “edge devices” have existed

The post Edge Kubernetes with Venkat Yalla appeared first on Software Engineering Daily.

Jul 30, 2018
Kubernetes in the Enterprise with Aparna Sinha
59:07

Enterprises want to update their technology faster. One way an enterprise can accelerate the adoption of new tools is to move more aggressively towards the cloud. By giving internal developers access to the cloud, it becomes easier to provision new servers–allowing for rapid experimentation, test environments, and scalability. In previous shows we have explored how

The post Kubernetes in the Enterprise with Aparna Sinha appeared first on Software Engineering Daily.

Jul 23, 2018
Git Vulnerability with Edward Thomson
55:41

Git is a distributed file system for version control. Git is extremely reliable, fast, and secure, owing to the fact that it is one of the oldest pieces of open source software. But even battle-tested software can have vulnerabilities. In this episode, we explore a subtle git vulnerability that could have potentially led to git

The post Git Vulnerability with Edward Thomson appeared first on Software Engineering Daily.

Jul 17, 2018
Shopify Infrastructure with Niko Kurtti
53:44

Shopify runs more than 600,000 small business websites. When Shopify was figuring out how to scale, the engineering teams did not have a standard workflow for how to deploy and manage services. Some teams used AWS, some teams used Heroku, some teams used other infrastructure providers. To manage all those stores effectively, Shopify has built

The post Shopify Infrastructure with Niko Kurtti appeared first on Software Engineering Daily.

Jun 27, 2018
Function Platforms with Chad Arimura and Matt Stephenson
52:58

“Serverless” is a word used to describe functions that get deployed and run without the developer having to manage the infrastructure explicitly. Instead of creating a server, installing the dependencies, and executing your code, the developer just provides the code to the serverless API, and the serverless system takes care of the server creation, the

The post Function Platforms with Chad Arimura and Matt Stephenson appeared first on Software Engineering Daily.

Jun 26, 2018
Build a Bank: Monzo with Richard Dingwall
57:03

When you interact with your bank, it probably feels different than when you interact with a software technology company. That’s because the biggest banks in the world were started before software became such a universally important tool. Their core competency is banking–not consumer software. Today, most banks make consumer-facing software. But these banks were not

The post Build a Bank: Monzo with Richard Dingwall appeared first on Software Engineering Daily.

Jun 25, 2018
Rust Networking with Carl Lerche
53:37

Rust is a systems programming language with a distinct set of features for safety and concurrency. In previous shows about Rust, we explored how Rust can prevent crashes and eliminate data races through its approach to type safety and memory management. Rust’s focus on efficiency and safety makes it a promising language for networking code.

The post Rust Networking with Carl Lerche appeared first on Software Engineering Daily.

Jun 19, 2018
Container Storage with Jie Yu
59:24

A database stores data to an underlying section of storage. If you are an application developer, you might think of your persistent storage system as being the database itself–but at a lower level, that database is writing to block storage, file storage, or object storage. A container orchestration system manages application containers. If you want

The post Container Storage with Jie Yu appeared first on Software Engineering Daily.

Jun 06, 2018
Container Native Development with Ralph Squillace
55:01

Containers have improved deployments and resource utilization. Kubernetes created a platform to manage those containers and orchestrate them into distributed applications. In today’s episode, we explore tools that improve the workflow of the application developer who is working with Kubernetes, including Helm, Draft, and Brigade. Helm is a package manager for Kubernetes, which allows users

The post Container Native Development with Ralph Squillace appeared first on Software Engineering Daily.

May 30, 2018
Container Security with Maya Kaczorowski
47:21

Deploying software to a container presents a different security model than deploying an application to a VM. There is a smaller attack surface per container, but the container is colocated on a node with other containers. Containers are meant to have a shorter lifetime than VMs, so there are generally fewer consequences if a container

The post Container Security with Maya Kaczorowski appeared first on Software Engineering Daily.

May 22, 2018
Alexa Voice Design with Paul Cutsinger
55:03

Voice interfaces are a newer form of communicating with computers. Alexa is a voice interface platform from Amazon. Alexa powers the Amazon Echo, as well as Alexa-enabled cars, refrigerators, and dishwashers. Any developer can build a device with a voice interface using a Raspberry Pi. Paul Cutsinger works on Echo and Alexa at Amazon. He’s

The post Alexa Voice Design with Paul Cutsinger appeared first on Software Engineering Daily.

May 18, 2018
Gloo: Function Gateway with Idit Levine
56:28

Gloo is a function gateway built on top of the popular open source project Envoy. The goal of Gloo is to decouple client-facing APIs from upstream APIs. Gloo is similar to an API gateway, which is a tool that software companies can use to collect all their APIs and one place and impose security, monitoring,

The post Gloo: Function Gateway with Idit Levine appeared first on Software Engineering Daily.

May 16, 2018
Cluster Schedulers with Ben Hindman
1:08:34

Mesos is a system for managing distributed systems. The goal of Mesos is to help engineers orchestrate resources among multi-node applications like Spark. Mesos can also manage lower level schedulers like Kubernetes. A common misconception is that Mesos aims to solve the same problem as Kubernetes, but Mesos is a higher level abstraction. Ben Hindman

The post Cluster Schedulers with Ben Hindman appeared first on Software Engineering Daily.

May 11, 2018
Affirm Engineering with Libor Michalek
59:52

When I buy a mattress online, I pay for it with my credit card. Behind the scenes, a complex series of transactions occur between a payment gateway, the credit card company, and a few banks. There are problems with this process–it is slow, complex, and involves the synchronization of several different parties. Some consumers will

The post Affirm Engineering with Libor Michalek appeared first on Software Engineering Daily.

May 07, 2018
Superpedestrian Robotic Wheel / Infrastructure at HubSpot Meetup Talks
1:02:21

Superpedestrian is a robotic bicycle wheel that learns how you pedal and personalizes your bicycle ride. The engineering challenges of Superpedestrian are at the intersection of robotics, software, and real-time analytics. The first half of today’s show is about Superpedestrian. Goss Nuzzo Jones and Matt Cole are engineers at Superpedestrian. The slides for their presentation

The post Superpedestrian Robotic Wheel / Infrastructure at HubSpot Meetup Talks appeared first on Software Engineering Daily.

May 05, 2018
Building Datadog with Alexis Le-Quoc
52:38

Alexis Le-Quoc started Datadog in 2010, after living through the Internet boom and bust cycle of the late 90s and early 2000s. In 2010, cloud was just starting to become popular. There was a gap in the market for infrastructure monitoring tools, which Alexis helped fill with the first version of Datadog. Since 2010, the

The post Building Datadog with Alexis Le-Quoc appeared first on Software Engineering Daily.

May 02, 2018
Google Cluster Evolution with Brian Grant
51:21

Google’s central system for managing compute resources is called Borg. On Borg, millions of Linux containers process a wide variety of workloads. When a new application is spun up, Borg provides that application with the resources it needs. Workloads at Google usually fall into one of two distinct categories: long-running application workloads (such as Gmail)

The post Google Cluster Evolution with Brian Grant appeared first on Software Engineering Daily.

Apr 27, 2018
NATS Messaging with Derek Collison
1:06:46

A message broker is an architectural component that sends messages between different nodes in a distributed system. Message brokers are useful because the sender of a message does not always know who might want to receive that message. Message brokers can be used to implement the “publish/subscribe” pattern, and by centralizing the message workloads within

The post NATS Messaging with Derek Collison appeared first on Software Engineering Daily.

Apr 24, 2018
Stripe Observability Pipeline with Cory Watson
1:08:01

Stripe processes payments for thousands of businesses. A single payment could involve 10 different networked services. If a payment fails, engineers need to be able to diagnose what happened. The root cause could lie in any of those services. Distributed tracing is used to find the causes of failures and latency within networked services. In

The post Stripe Observability Pipeline with Cory Watson appeared first on Software Engineering Daily.

Apr 23, 2018
Monitoring Kubernetes with Ilan Rabinovitch
50:31

Monitoring a Kubernetes cluster allows operators to track the resource utilization of the containers within that cluster. In today’s episode, Ilan Rabinovitch joins the show to explore the different options for setting up monitoring, and some common design patterns around Kubernetes logging and metrics gathering. Ilan is the VP of product and community at Datadog.

The post Monitoring Kubernetes with Ilan Rabinovitch appeared first on Software Engineering Daily.

Apr 16, 2018
Go Systems with Erik St. Martin
57:53

Go is a language designed to improve systems programming. Go includes abstractions that simplify aspects of low level engineering that are historically difficult—concurrency, resource allocation, and dependency management. In that light, it makes sense that the Kubernetes container orchestration system was written in Go. Erik St. Martin is a cloud developer advocate at Microsoft, where

The post Go Systems with Erik St. Martin appeared first on Software Engineering Daily.

Apr 11, 2018
Database Chaos with Tammy Butow
59:54

Tammy Butow has worked at Digital Ocean and Dropbox, where she built out infrastructure and managed engineering teams. At both of these companies, the customer base was at a massive scale. At Dropbox, Tammy worked on the database that holds metadata used by Dropbox users to access their files. To call this metadata system simply

The post Database Chaos with Tammy Butow appeared first on Software Engineering Daily.

Apr 10, 2018
Site Reliability Management with Mike Hiraga
47:17

Software engineers have interacted with operations teams since software was being written. In the 1990s, most operations teams worked with physical infrastructure. They made sure that servers were provisioned correctly and installed with the proper software. When software engineers shipped bad code that took down a software company, the operations teams had to help recover

The post Site Reliability Management with Mike Hiraga appeared first on Software Engineering Daily.

Apr 09, 2018
Cloud and Edge with Steve Herrod
1:03:44

Steve Herrod led engineering at VMWare as the company scaled from 30 engineers to 3,000 engineers. After 11 years, he left to become a managing director for General Catalyst, a venture capital firm. Since he has both operating experience and a wide view of the technology landscape as an investor, he is well-equipped to discuss

The post Cloud and Edge with Steve Herrod appeared first on Software Engineering Daily.

Feb 23, 2018
Serverless Systems with Eduardo Laureano
1:01:30

On Software Engineering Daily, we have been covering the “serverless” movement in detail. For people who don’t use serverless functions, it seems like a niche. Serverless functions are stateless, auto-scaling, event driven blobs of code. You might say “serverless sounds kind of cool, but why don’t I just use a server? It’s a paradigm I’m

The post Serverless Systems with Eduardo Laureano appeared first on Software Engineering Daily.

Feb 22, 2018
Cloud Foundry Overview with Mike Dalessio
1:02:40

Earlier this year we did several shows about Cloud Foundry, followed by several shows about Kubernetes. Both of these projects allow you to build scalable, multi-node applications–but they serve different types of users. Cloud Foundry encompasses a larger scope of the application experience than Kubernetes. Kubernetes is lower level, and is actually being used within

The post Cloud Foundry Overview with Mike Dalessio appeared first on Software Engineering Daily.

Feb 21, 2018
Box Kubernetes Migration with Sam Ghods
56:17

Over 12 years of engineering, Box has developed a complex architecture of services. Whenever a user uploads a file to Box, that upload might cause 5 or 6 different services to react to the event. Each of these services is managed by a set of servers, and managing all of these different servers is a

The post Box Kubernetes Migration with Sam Ghods appeared first on Software Engineering Daily.

Feb 13, 2018
Scaling Box with Jeff Quiesser
48:11

When Box started in 2006, the small engineering team had a lot to learn. Box was one of the earliest cloud storage companies, with a product that allowed companies to securely upload files to remote storage. This was two years before Amazon Web Services introduced on-demand infrastructure, so the Box team managed their own servers,

The post Scaling Box with Jeff Quiesser appeared first on Software Engineering Daily.

Feb 12, 2018