Episode 21

The OSOM effort behind building an Android phone (feat. Jason Keats)

Published on: 11th July, 2022

It's a two-part special on Android Bytes as we chat with two execs from OSOM Privacy, an Android startup founded from the remains of Andy Rubin's Essential. In this episode, we talk about the company's first product, the Solana Saga, and what it's like building an Android experience from scratch.

With us are OSOM CEO Jason Keats and CPO Gary Anderson. You can learn more about the Saga here.

  • 02:22 - After Essential shut down, why start another smartphone company?
  • 06:38 - Why do so many smartphones use the same build materials?
  • 09:05 - What's the Solana Saga all about?
  • 15:06 - Does the Solana Saga ship with GMS? What is the software experience like?
  • 18:02 - How exactly does a company bring Android with GMS onto a new device? What are the steps involved?
  • 21:26 - What is a MADA? Why do companies have to sign it?
  • 22:17 - Why can't a company launch a GMS product with any version of Android and security patch level? Is this requirement burdensome?
  • 27:12 - How does one validate that their Android build will pass Google certification? What is xTS and how long does it take to run it?
  • 31:23 - What is a 3PL? What happens when a build passes certification?
  • 33:21 - How did Essential manage to ship day 1 Android updates?
  • 34:50 - How do carriers play a role in Android updates?

Android Bytes is hosted by Mishaal Rahman, Senior Technical Editor, and David Ruddock, Editor in Chief, of Esper.

Esper enables next-gen device management for company-owned and managed tablets, kiosks, smart phones, IoT edge devices, and more.

For more about Esper:

New from the Esper blog:

Our music is "19" by HOME and is licensed under CC BY 3.0.

Transcript
David:

Hello, and welcome to Android bites powered by Esper I'm David

David:

Rudick and each week I'm joined by my co-host Michelle ramen.

David:

As we dive deep into the world of Android.

David:

And this week, I won't begin with any long preamble.

David:

We have a very special guest series of guests actually.

David:

Um, we have two guests now, but, uh, yeah, Michelle, we have somebody very special.

David:

So go ahead.

David:

Let you make intros.

Mishaal:

Yeah.

Mishaal:

Thanks David.

Mishaal:

So I'm sure all of you.

Mishaal:

At one point, I've had an opinion on what the ideal smartphone should

Mishaal:

have, but there's no true one size fits all device out there.

Mishaal:

Every device lacks something that's important to someone out there.

Mishaal:

And if there's enough, someone's out there to demand that something, then

Mishaal:

there's an opportunity for a new product to be made that meets that demand.

Mishaal:

For those of you who follow tech news a couple of weeks ago, the founder

Mishaal:

of pebble actually made headlines.

Mishaal:

When he started an online petition for people to sign onto, to say, Hey, we

Mishaal:

want a iPhone minis size Android phone.

Mishaal:

There were about 50,000 people sign onto the petition.

Mishaal:

And of course, you know, if you're familiar with online petitions, they

Mishaal:

usually don't really do anything, but still like he wanted to show the world.

Mishaal:

He wanted to show that there are enough people who actually

Mishaal:

want a small Android phone.

Mishaal:

Unlike most people out there, founder of pebble, he actually has the money,

Mishaal:

connections and experience in the industry to make his dream a reality.

Mishaal:

But of course he's not the only one who has all three of those things to do that.

Mishaal:

Recently there's been not one, but two smartphone companies that

Mishaal:

have launched or at least one will be launching their product soon.

Mishaal:

The other is awesome and we've invited two very special people from the company to

Mishaal:

join us on the Android bites podcast, to talk about their first smartphone product.

Mishaal:

So we've invited Jason Keats.

Mishaal:

Who's the founder and CEO and Gary Anderson.

Mishaal:

Who's the chief product officer onto the show.

Mishaal:

So thank you for joining us, Jason and Gary.

Jason:

Hey, thanks for having us excited to be here.

Jason:

Letting chat with you guys about building Android devices.

Jason:

Yep.

Jason:

Happy to be

Gary:

here too.

Gary:

Uh, looking forward to telling you

Mishaal:

about saga.

Mishaal:

Hey listeners, before we get too far, I wanna let you know that our

Mishaal:

interview went pretty long, so we'll be splitting it up into two episode.

Mishaal:

In this first episode, we are focusing a lot on building up the Android

Mishaal:

experience that Austin wanted to have.

Mishaal:

There's also plenty of insight, Gary and Jason share as to how a

Mishaal:

lot of these aspects worked out when their team was part of essential.

Mishaal:

And then in our next episode, we'll turn to how they plan to keep their

Mishaal:

OS updated and then dive into some of how the salon mobile stack will work.

Mishaal:

But let's first get started with part one.

Mishaal:

So right off the bat, why don't we just dive into the product

Mishaal:

that you're launching and the company that you found at Jason?

Mishaal:

So for those of you don't know, Jason was the head of R and D at essential,

Mishaal:

another smartphone startup that produced the now discontinued essential phone.

Mishaal:

I don't really wanna, re-litigate what happened to essential because

Mishaal:

that's kind of old history and you can just pretty much just Google

Mishaal:

it and look up what happened.

Mishaal:

So why did you decide to found awesome after leaving essential?

Mishaal:

Like what did you feel was lacking in the Steve smartphones release in 2020.

Mishaal:

Led you to want to make your own?

Mishaal:

Well,

Jason:

there are two parts to that.

Jason:

Number one is there was a real need and demand for a smartphone that was a quality

Jason:

bill, premium materials, excellent device, but it needed to answer some question.

Jason:

And I think that was the biggest thing missing from essential.

Jason:

You could look up all the different details about why essential one enter.

Jason:

But ultimately my viewpoint was that there wasn't really a reason for it to exist.

Jason:

It was like we're building a cool thing for the sake of building a cool thing.

Jason:

And when we started awesome, we kind of sat down and said, what do we wanna build?

Jason:

How do we wanna build it?

Jason:

What are we trying to answer?

Jason:

And the first thing we came to was there is an extreme lack of privacy

Jason:

and people do care about it and are willing to put money behind it.

Jason:

And so that was the ethos behind starting the company.

Jason:

The other side of it was when Andy told me essential was shutting down, it was

Jason:

like, okay, well I can go make big bucks at apple or Google again, if I want to.

Jason:

And in no way, did that sound entertaining to me or fun to me and starting a

Jason:

company it's very, very difficult.

Jason:

There are so many challenges.

Jason:

Probably the hardest thing is hiring.

Jason:

And yet here I had the opportunity to hire a team of people that I've worked with.

Jason:

And we've been through the trenches together with that.

Jason:

We know how each other works and how each other behaves and they were all available.

Jason:

So it was a fairly simple move to go, Hey guys, let's stick together.

Jason:

I'll put my money where my mouth is and let's try to go and do this.

Jason:

And it would be actually super interest to hear Gary's side of this convers.

Gary:

Yeah, I think after the shutdown of, of essential the engineers, right.

Gary:

We're thinking where, where they could go lo and behold, Keith's, you know,

Gary:

we get a call from Jason here and he reaches out and says, Hey, I have a

Gary:

crazy idea and continues to pitch the idea to us and told us what was missing

Gary:

from essential and kind of what that would change into here at awesome.

Gary:

So privacy being our north star and then some of the stuff that we'd be doing.

Gary:

In terms of not only working in a different environment, which encouraged

Gary:

collaboration and a lot of communication with the CEO, but also a lot of different

Gary:

types of things that we truly believed in on a personal level and things that

Gary:

was kind of kind of rapidly growing in, in the, you know, sense of the markets

Gary:

in the EU and, uh, us and then things that are interesting, getting a lot

Gary:

more attention in different countries.

Mishaal:

I think it's quite interesting, or at least like incredible that the two

Mishaal:

of you and like, you know, the rest of the, the higher ups of the, the founders

Mishaal:

of awesome were able to convince so many former ex essential engineers to

Mishaal:

immediately join on board with you guys.

Mishaal:

Because after this company goes down to start up making a smartphone company,

Mishaal:

a lot of these ex engineers have a lot of built up experience in the industry.

Mishaal:

They could have gone to apple, they could have gone to Google.

Mishaal:

They could have gone to some of the more established brands, but.

Mishaal:

They had enough trust in your expertise and your idea to want

Mishaal:

to say, I wanna do this again.

Mishaal:

I want a second shot at this to go with another startup.

Mishaal:

So I think that's pretty impressive that you guys manage to scoop

Mishaal:

up so many former employees and start a new smartphone brand.

Jason:

I appreciate that.

Jason:

There has been a lot of negative things said about Andy in the press.

Jason:

And I gotta say one of the things that he did amazingly well was

Jason:

attracting just the best people in the industry to come and work for him.

Jason:

And for whatever reason, I, I don't know if there's like some, we all have the

Jason:

same mental defect or whatever you wanna call it, a willingness to chew glass

Jason:

and keep fighting and working together.

Jason:

And we.

Jason:

Like you said, it takes a matter of comradery or friendship to go through

Jason:

one startup, have it fail and just immediately sign up to do it again

Jason:

with the expectation that things will be different and making the changes

Jason:

at a, at a institutional level to see that those changes are implemented.

Jason:

And I cannot stress enough how amazed I am and how proud I am of

Jason:

this team that I have with me and who are on this adventure with.

Jason:

So

David:

I do wanna ask a hardware question, Jason, because I know we're

David:

gonna talk a lot about software today.

David:

The pH one really wasn't like any other Android phone before, or since

David:

I would say in terms of materials, design, even the aesthetic of

David:

the phone was markedly different.

David:

There was always something clearly very special about the engineering talent

David:

at essential on the hardware side.

David:

What do you think made it possible for you all to build what everybody else looks at?

David:

The big manufacturers, even, you know, the big conglomerates out of China,

David:

like oppo BBK group, and they say, okay, you have the scale, you can do this.

David:

You can make something really incredible.

David:

They always shy away, go back to like 7,000 series, aluminum standard

David:

glass materials, the same kind of bill that everybody goes for.

David:

Do you really think it is just money and that your freedom that

David:

you've given your team that enables you to make those Boulder choices?

David:

Or is there something like more systemic there?

Jason:

You know, it, it's a really good question.

Jason:

Why don't they do that?

Jason:

Number one, I think big companies, all.

Jason:

A million voices and a million opinions.

Jason:

Google is probably the worst example of that.

Jason:

I mean, looking at their hardware, you can clearly see it was designed

Jason:

by like four people and not a single mind was melding it together.

Jason:

It's like, cool, you do the front and all to the back and we'll just glue

Jason:

them together and we'll call it a day.

Jason:

There's part of that.

Jason:

And then partly, you know, what I've seen in my career from a hardware perspective

Jason:

is when I'm sitting in China, I have seen so many vendors just get abused

Jason:

by engineers from different companies and like, just get treated like.

Jason:

My thing has always been to treat everybody respect and love and show

Jason:

a measure of comradery for everybody.

Jason:

And what that means is when I have something that's stupid or crazy,

Jason:

like machining ceramic on the back of the essential pH one, the 0.02, five

Jason:

millimeter tolerance to get the SI beam chip to work means that they were

Jason:

willing to work with me and go like, cool, Jason's a crazy bastard, but let's

Jason:

work with him cuz he's a lot of fun.

Jason:

I've maintained that relationship with all the vendors and all the suppliers,

Jason:

which has allowed us to play at a level that no startup should be able to play at.

Jason:

I mean, we called Foxcon.

Jason:

We called all the big tier one developers and manufacturing houses.

Jason:

We're like, we're gonna do this.

Jason:

And I'm like, cool, whatever you need, we got you.

Jason:

I don't think anybody could do that today.

Jason:

I, I know for a fact that, uh, one of the other brand new phone companies

Jason:

needed my help to get intros at that.

Jason:

And

Mishaal:

he shouldn't have, um, said phone company will

Mishaal:

remain unnamed just to be clear.

Mishaal:

Yes . So, um, exactly the topic of this discussion is mostly

Mishaal:

about building Android and shipping, Android onto a device.

Mishaal:

And I promise we're gonna get to that, but I wanted to first give

Mishaal:

you an opportunity to talk about the end result, the actual product that

Mishaal:

you guys are releasing next year.

Mishaal:

So can you tell us a bit, Jason and Gary, about the Solana saga?

Mishaal:

What sets it apart from other flagship Android phones?

Jason:

Right now what we're doing is from a hardware perspective, it

Jason:

is a top flight, absolute flagship Android device of which there

Jason:

aren't that many left anymore.

Jason:

You have Samsung, and I don't know what's in the pixel seven, to be honest, but

Jason:

certainly the last couple pixels weren't flagship in terms of mechanical hardware

Jason:

spec, their software has been tremend.

Jason:

So what we are doing is a true flagship device that can compete on

Jason:

specs alone with Google or Samsung.

Jason:

What's different about it is we are trying to give users.

Jason:

Everything we do is all about providing consumer choice and choice and control

Jason:

over how their data is handled, which goes to the awesome privacy ethos, but

Jason:

also now how they control, interact with their digital assets, which is where

Jason:

the salon mobile stack comes in on saga.

Jason:

And we can spend quite a bit of talking about the relationship

Jason:

between awesome and saga right now.

Jason:

What it really comes down to is both a Toley who's the

Jason:

CEO and co-founder of Solana.

Jason:

And I have in common is that we did see this incredible opportunity where they

Jason:

wanted to build some hardware for the future of web three to be developed with.

Jason:

And we've seen for years that mobile is the leader, not desktop.

Jason:

And yet in the crypto space, desktop was ex or like they

Jason:

were developing exclusively for desktop, which made no sense.

Jason:

What we're doing is building a home for web three developers to build

Jason:

onto mobile hardware, which really is what most people use day to day.

Jason:

And from a software perspective, I'll hand it back over.

Jason:

Yeah,

Gary:

I think what we're gonna end up seeing is there's gonna be a difference

Gary:

from our device and how it evolves versus some of the other ones that

Gary:

are made by these mega corporations.

Gary:

Right?

Gary:

So there's gonna be stuff that's leaning heavily into what web three and

Gary:

decentralization at its core is meant to provide as well as taking a lot of and

Gary:

leaning into the open source community.

Gary:

Right?

Gary:

So I think having amending those two together on a flagship device, I'm

Gary:

more excited about the evolution.

Gary:

And this being a flagship phone and hardware to how that evolving software,

Gary:

I think that's what we're most excited to

Mishaal:

see.

Mishaal:

Thank you both for that.

Mishaal:

It's really important for any new phone on the market to stand out.

Mishaal:

And this partnership with Solana, I'm sure many people have differing opinions on

Mishaal:

cryptocurrency, web three NFTs, et cetera.

Mishaal:

Yeah, to say the least, there's certainly many heated opinions on them.

Mishaal:

And I don't really wanna Wade into those differences of opinions, but

Mishaal:

it is well, let, let very unique aspect, wait in our answer to

Jason:

that really quickly.

Jason:

Is that again, I keep reiterating it's all about choice.

Jason:

If a user doesn't want to use the crypto features, there

Jason:

is no obligation to use them.

Jason:

There is no forcing function.

Jason:

There is nothing there that requires it.

Jason:

If you just want a premium Android experience on a premium flagship device.

Jason:

The Sal salon of saga is a perfect device.

Jason:

It just gives you more options and

Mishaal:

more control.

Mishaal:

And that's exactly what I'd like to see.

Mishaal:

A lot of times I see a company release a product that focuses exclusively

Mishaal:

on the gimmick, but they don't really bother with all the other aspects.

Mishaal:

There might be some deficient aspects.

Mishaal:

I notice this a lot with gaming phones and for example, like they're

Mishaal:

highly optimized for gaming, but.

Mishaal:

They might sacrifice intentionally one or two aspects, which just didn't

Mishaal:

get around to actually bothering with the other aspects of making

Mishaal:

a smartphone, a usable smartphone.

Mishaal:

And, uh, yeah, the one that

Jason:

always good to hear cracks me up to your point is both on gaming phones

Jason:

and some of the like security minded phones that people have tried to release.

Jason:

They kind of suck as an actual phone, their connectivity is terrible.

Jason:

They've sacrificed antenna quality for various reasons.

Jason:

And we went into this with, we need to build a flagship phone.

Jason:

This needs to be a great phone first and foremost.

Jason:

And then we're gonna add to that.

Jason:

Yeah.

David:

And I think that one example you might be citing there is Blackberry,

David:

which I think we can say, because I mean, it's functionally dead anyways.

David:

As far the smartphone company.

David:

Yeah, TCL owns the rights, but they get phones made for the India

David:

market that are rebranded there.

David:

So yeah, they're doing some really interesting stuff, but yeah, I

David:

always felt that they tried to sell that security image and I think it

David:

came down to, they had a password protected folder function, basically.

David:

yeah.

David:

And they did some hand waving about how secure their boot was.

David:

Like, it, it, it just did not do anything to sell the product and it

David:

didn't help that the phones were.

Jason:

Yeah, exactly.

Jason:

Exactly.

Jason:

I mean, there are two far more niche devices that people have mentioned in

Jason:

conjunction with us as a privacy company that I know for a fact, so less than

Jason:

a thousand devices totaled because we all use the same vendors, right.

Jason:

Everybody uses the same vendors for like speakers and stuff like that.

Jason:

Apple included, well, vendors are under NDAs.

Jason:

They tend to share a lot.

Jason:

So, uh, I know for a fact that like one of the speaker vendors is

Jason:

like, we only shipped a thousand speakers total to that company.

Jason:

And so it goes to your point, right?

Jason:

They.

Jason:

Some cool stuff, but they forgot the key point is it needs to

Jason:

be a great phone to start.

Jason:

And it's one of the lessons we learned a lot when we left essential was okay.

Jason:

We better make sure the camera's fantastic.

Jason:

So literally one of the first calls I made was to some of the tuning

Jason:

houses where I just said, just give me a number and we'll make sure

Jason:

this camera experience is fantastic.

Gary:

And on top of that, I think giving people the choice and control people will

Gary:

still have all of the stuff that they're used to using on their Android device.

Gary:

I just wanna make that crystal clear, right?

Gary:

We're adding stuff.

Gary:

In addition to complimenting a lot of stuff that Google's doing

Gary:

already in the privacy space, we're not stepping on their toes.

Gary:

We're kind of building alongside.

Gary:

Of things that only an OEM can build.

Gary:

And that has been our main focus is, is doing that a community should definitely

Gary:

know that, that they're not giving up anything, Google service related.

Gary:

They may have more control over controlling what their device can do

Gary:

at that point, but out of the box, taking what people loved about the

Gary:

essential pH one and making sure that that kind of reflected into the

Gary:

awesome device and experience as well,

Mishaal:

was really important to.

Mishaal:

Part of what separates an Android phone from the realm of obscurity

Mishaal:

to mainstream is whether or not it chips with Google mobile services.

Mishaal:

And that's just, unfortunately, the way things are because Google play

Mishaal:

store is the ubiquitous Android app repository for Android devices.

Mishaal:

Google play services is used by tens of thousands of apps for

Mishaal:

push notifications and other APIs.

Mishaal:

And so that's why when I was reading the soak announce.

Mishaal:

I was wondering, will this ship with Google mobile services?

Mishaal:

And the answer seems to be yes, according to the webpage, and I'm sure you both

Mishaal:

can confirm that now for us, if you can.

Mishaal:

Yep.

Mishaal:

Yeah, absolutely.

Mishaal:

Right.

Mishaal:

And I also wanted to ask a bit about the software experience on the device.

Mishaal:

Like, can you tell us anything about it?

Mishaal:

Would you describe it as stock?

Mishaal:

Like, or will it be like a lot of heavy customizations on top?

Gary:

Yeah.

Gary:

So this is something we contemplated early on in the development.

Gary:

We strictly talk about something privacy or security related.

Gary:

I think it goes really hand in hand with a stock, like feel with what

Gary:

people expect out of that experience.

Gary:

And again, I think that's something that our essential fan base really

Gary:

loved about our phone is having that stock feel, not string too far away,

Gary:

you know, not adding too many gimmicks on top of when inevitably will lead to

Gary:

like a longer lead time into merging security patches potentially, or

Gary:

migrating from one OHS to another.

Gary:

So right now, out of the box, we are leaning heavily to

Gary:

provide a stock like feel.

Gary:

So you manage the UBI, the outof box, experience, the launcher, the font, all

Gary:

things that you would feel Android 12 and.

Gary:

Eventually 13 will offer we're leaning pretty heavily.

Gary:

As Solana has a pretty strong brand presence.

Gary:

There are opportunities to create those branded moments.

Gary:

So you can think of things like boot, animation, charging animation sounds.

Gary:

We may even contemplate putting in some icon packs and potentially

Gary:

some Easter eggs in there as well.

Gary:

But generally, I don't think we'll stray too far away from, from stock Android

Gary:

and especially an initial V1 release.

Gary:

Yeah.

Gary:

And just

Jason:

to add on to that, one of the things that I tasked

Jason:

the team with was making sure.

Jason:

Even the menus felt familiar so that if you use an Android device,

Jason:

this should feel everything.

Jason:

We add.

Jason:

All the privacy features we add should feel like they're almost stock.

Jason:

I am genuinely concerned that at some point, somebody go like, wait a second.

Jason:

This isn't just stock vanilla, Android.

Jason:

This is something somebody else built.

Jason:

And then we have to explain to them so, uh, it'll be interesting

Jason:

to see how that plays out.

Mishaal:

Yeah.

Mishaal:

It's always hard to tell people because the term stock

Mishaal:

Android is kind of meaningless.

Mishaal:

Because people kind of assume it means AOS P but nobody actually

Mishaal:

runs peer a S P on their device.

Mishaal:

They're actually running, always something on top of it, including GMs, usually when

Mishaal:

they include, when they say stock Android.

Jason:

Yeah.

Jason:

They're, they're really referring to GMs, Android, not AOSP.

Jason:

Right.

Gary:

Right.

Gary:

I think a S P is not usable in its natural state.

Gary:

There's no way, anyway, it's gonna run that without running a custom rom or

Gary:

some sort of launcher on top of it.

Gary:

So I think we could agree

Mishaal:

here that that's the.

Mishaal:

Which kind of brings me to the next topic that I wanted to dive into.

Mishaal:

How exactly does a company like awesome.

Mishaal:

Actually bring Android onto a prototype piece of hardware

Mishaal:

that you're developing on.

Mishaal:

So even if a phone ships with what looks like to be basically stock

Mishaal:

Android, which is how people would feel, the experience will be on the saga.

Mishaal:

A lot of effort actually goes into making that happen.

Mishaal:

So it's not just like companies go and download a SP from

Mishaal:

Google's get repositories.

Mishaal:

Then they customize a source code a bit, and then they compile

Mishaal:

and ship that bill onto devices.

Mishaal:

Because even though that would boot, that's basically just a

Mishaal:

GSI, a generic system image.

Mishaal:

If there's any individual hardware idiosyncrasies to deal with and

Mishaal:

you wanna ship GMs, then that's not going to work because you

Mishaal:

have to pass certification tests.

Mishaal:

You need to deal with extra drivers or any framework changes to enable extra

Mishaal:

hardware features so on and so forth.

Mishaal:

So there's like a lot of little things that have to happen, and it's

Mishaal:

not as simple as just, I'll take a O S P and I'll ship that onto a

Mishaal:

device with a few customizations.

Mishaal:

That's not how the vast majority of products are actually sold.

Mishaal:

Just to take a step back.

Mishaal:

I wanted to talk about the developments life cycle of an

Mishaal:

Android phone launch in, in general.

Mishaal:

So first thing that happens, companies come up with concepts of their

Mishaal:

phone design, what specs components they should source, what target,

Mishaal:

what price they're gonna target.

Mishaal:

And during this process, if you know, you're going to ship a consumer Android

Mishaal:

smartphone that you want people to actually buy, you know, you're going

Mishaal:

to want to license GMs at some point.

Mishaal:

And because of that, you have to be prepared well in advance

Mishaal:

for actually getting an approval for the license and actually

Mishaal:

passing the compatibility require.

Mishaal:

Surprisingly, there are very few hardware requirements in the Android

Mishaal:

compatibility definition document, but there are some, there's a

Jason:

that's now, and there were four years

Mishaal:

ago.

Mishaal:

Yeah.

Mishaal:

Just cause Android is a constantly evolving ecosystem.

Mishaal:

So Google's recognized devices can be bigger, smaller, they can be foldable.

Mishaal:

Right.

Mishaal:

So we gotta account for these changing times.

Mishaal:

But if you know, you're gonna bring a phone to market with GMs,

Mishaal:

then you have to talk to Google.

Mishaal:

At some point, talking to Google means literally filling out a form.

Mishaal:

Like they have a form on their website.

Mishaal:

That says, like, what's the product you're gonna launch?

Mishaal:

What Android version do you wanna launch it with?

Mishaal:

About how many products do you wanna sell?

Mishaal:

It's literally just a form.

Mishaal:

And then someone from Google will get back to you.

Mishaal:

And then along the process, you'll get lawyers involved, you sign a

Mishaal:

mobile application distribution agreement, and that motto of

Mishaal:

course is super confidential.

Mishaal:

So I'm sure I, I can't even bother.

Mishaal:

I'm not even gonna bother asking you to.

Mishaal:

What goes into that, because it's just, yeah.

Mishaal:

You can't talk about that.

Mishaal:

You

Jason:

know, honestly, it's a bit easier than that these days.

Jason:

I know for a fact that five, six years ago it was more difficult than it is today.

Jason:

Like you said, you start with just submitting a form.

Jason:

You get a call.

Jason:

Certainly we're a little bit different because we already had long established

Jason:

relationships with everybody over there.

Jason:

So it started with, Hey, uh, where do I sign up for this again?

Jason:

Like send an email before we sent the form and the motto is a lot

Jason:

less stringent than it used to be.

Jason:

Mostly because like you said, devices are changing.

Jason:

I remember when we did the essential phone, we added the notch, it was the

Jason:

first phone with the notch and it was a violation of Mo they're like, oh, you

Jason:

can't change the menu from the top too.

Jason:

And we're like, well, there's a hole in the top of our screen.

Jason:

Now it's changed a lot to accommodate for different form

Jason:

factors, different implementations.

Jason:

I think the gem phone, when we tried to build it at essential would not have been.

Jason:

There's no way they were gonna let it slide, but now it might be feasible.

Mishaal:

To return back to my point, though, that the motto is what actually is

Mishaal:

a legal agreement that allows an Android partner company like awesome to actually

Mishaal:

license and ship GMs on the products.

Mishaal:

And more importantly are equally as important to use the Android

Mishaal:

trademark in branding because, uh, for those of you don't know, Android.

Mishaal:

It's actually a trademarked term by Google.

Mishaal:

So like there's a O S P, which is an operating system.

Mishaal:

And then there's Android.

Mishaal:

And you can't say your product runs Android, unless it

Mishaal:

has a O S P with GMs on it.

Mishaal:

So it's a, it's a very sticky point, very minor thing.

Mishaal:

But that's how Google controls the terms of what companies can say.

Mishaal:

They're using Android.

Mishaal:

Of course, once you verify your hardware informed factor meets

Mishaal:

the compatibility requirements.

Mishaal:

And once you're sure you have a viable product, then you start securing

Mishaal:

components, designing prototypes, and developing software, all stuff

Mishaal:

that requires a lot of money and a lot of prep work to do, but

Mishaal:

here's one stickler in the process.

Mishaal:

So the software that you are developing for the device, it can't just be any

Mishaal:

arbitrary version of Android that you want and any arbitrary security

Mishaal:

patch level, because Google actually has requirements around this.

Mishaal:

If you were to launch a product without GMs, then you can do

Mishaal:

whatever you want with ASB.

Mishaal:

You could launch Android seven.

Mishaal:

If you wanted to on a new product, they wouldn't be able to control that.

Mishaal:

But if you wanna ship GMs, you have to abide by Google's requirements.

Mishaal:

And that means you have to actually abide by their launch approval

Mishaal:

windows for each version of Android.

Mishaal:

So what happens that if you try to submit a build for approval after the approval

Mishaal:

window for that version of Android is expired, then it won't be certified.

Mishaal:

So for example, In like two years from now, we try to send Google an Android

Mishaal:

10 base bill for certification, they'll say, nuh, that approval windows expired.

Mishaal:

You can't launch that.

Mishaal:

The expiration for an approval window date kind of varies.

Mishaal:

And it's all like confidential.

Mishaal:

It's in like a timeline, but in general, the new software bills are updates are

Mishaal:

certified until two letter releases later.

Mishaal:

So for example, all Android, 12 based software releases.

Mishaal:

If an OEM wants to ship an Android tele based update, they can continue to

Mishaal:

do so until the launch of Android 14.

Mishaal:

So, this is kind of a way to ensure that OEMs are launching products

Mishaal:

with newer versions of Android and with newer security batch levels,

Mishaal:

which I'll get into in a little bit.

Mishaal:

So this sounds like a short timeframe for partners to actually develop

Mishaal:

their operating systems based on the platform release, which is why

Mishaal:

Google provides at least some of its partners with early access to the

Mishaal:

next platform release through the platform development kit or PDK for.

Mishaal:

And as I mentioned before, on top of the Android version requirement,

Mishaal:

Google also requires that if you're submitting a bill for approval, it

Mishaal:

has to have a security patch level.

Mishaal:

That's at most two months old at the time of submission.

Mishaal:

So because partners get security patches 30 days ahead of the public bulletin.

Mishaal:

So your, your security patch level has to be at most 90 days old

Mishaal:

from the latest partner patch.

Mishaal:

That was a lot to take in.

Mishaal:

I'm sure for some of our listeners, I kind want to ask you a bit here.

Mishaal:

This is, uh, not a question I had on the outline, but.

Mishaal:

I wanted to ask you your thoughts on like this approval window and like

Mishaal:

Google trying to keep manufacturers on an up to date version of Android

Mishaal:

and on an up to date, security patch level, like, is this a burdensome to

Mishaal:

manufacturers or do you think this is actually a good thing that most

Mishaal:

manufacturers are able to keep up with?

Jason:

So it's a yes and no question.

Jason:

Yes.

Jason:

I think it's a good idea and I really appreciate that they do it.

Jason:

And I think they're right to make sure that manufacturers are building

Jason:

with the latest and greatest.

Jason:

The thing that I don't agree with, and I'm sure every manufacturer of an

Jason:

Android device on the planet will agree.

Jason:

Being forced to use third party labs to do this certification

Jason:

rather than be able to do it.

Jason:

Direct thing of Google.

Jason:

And we are very, very fortunate when we were at essential because of Andy

Jason:

Rubin's obvious connection to Android.

Jason:

For those who don't know, he's the, basically the creator of Android.

Jason:

Who sold it to Google?

Jason:

Uh, so we did get some relatively special treatment which allowed us to do our

Jason:

security patches super, super quickly, because we were doing our own testing and

Jason:

submitting the results to Google directly.

Jason:

Unfortunately, we're not able to do that anymore and nobody is, and it,

Jason:

it is quite frustrating to use a third party, particularly when third

Jason:

priories don't move as fast as we do.

Jason:

So when we could do normally something in a couple of days,

Jason:

now it'll take a week or.

Jason:

I think

Gary:

everything's net positive in this regard.

Gary:

I think it is a burdensome a bit in terms of regulation and what they kind of put

Gary:

as requirements as any requirement would cause, uh, extension in, in the timeline

Gary:

that you're trying to launch a device, but I think overall getting it more

Gary:

cohesive, maintaining a certain level of functionality and future sets at minimum.

Gary:

Because Android, as we know, it is so fragmented and has been over

Gary:

a decade now for different OEMs.

Gary:

I think it does bring a net positive feel on having the latest

Gary:

and greatest security patches.

Gary:

Right.

Gary:

We could see that with other OEMs who used to take up to a year and

Gary:

rolling out a security patches now within a couple months timeframe.

Gary:

And I, I think that that's very, very invaluable, right.

Gary:

For anyone owning a device and it's.

Gary:

Almost a moral requirement to do so as well.

Gary:

Right.

Gary:

And for us, that was really important to us at essentials was rolling out

Gary:

those as soon as we had it going through and setting up a whole

Gary:

CTS setup within our office space.

Gary:

So that way our pre CTS setup was now our production CTS setup.

Gary:

And then we were able to get it out, have it ready?

Gary:

A lot of the times, as soon as Google devices had them.

Gary:

Yeah, there's a, a trade off between what Google has as part

Gary:

of their whole XTS suite of tests.

Gary:

That includes CTS VTS, GT.

Gary:

Its right.

Gary:

All those things kind of like meld into this whole test suite

Gary:

of millions of tests, but it's for the greater good, right.

Gary:

They want a certain bar met for Android devices that exist that

Gary:

people get their hands into.

Gary:

Right.

Gary:

We've seen it too often in movies where Android is a butt of a joke because of the

Gary:

less superior experiences that can happen, unfortunately, with, with other OEMs.

Gary:

So yeah, overall, it's, it's one of those things that we welcome.

Gary:

So

Mishaal:

both of you kind of touched upon topics.

Mishaal:

I wanted to explain a bit to our listeners room.

Mishaal:

If we may not be familiar, three PL the third party labs and CTS going

Mishaal:

on in the development life cycle that I've been talking about after the

Mishaal:

software has been developed to a state that's been near production ready,

Mishaal:

and then you've integrated the GMs using Google's provided packages and

Mishaal:

you verified the build is certifiable.

Mishaal:

Then it's time to actually validate that the build passes the various

Mishaal:

certification tests that you agree to run in order to ship GMs.

Mishaal:

These automated tests are installed on a PC and are run through a phone or

Mishaal:

multiple phones connected through ADB.

Mishaal:

And then after the tests run a report, that's generated with the results.

Mishaal:

So as Gary mentioned, there are a couple of tests starting with the

Mishaal:

broad compatibility test suite or CTS.

Mishaal:

Then there's a vendor test suite, which test vendor components.

Mishaal:

There's a mainline test suite.

Mishaal:

There's a CTS on GSI, which is the compatibility test

Mishaal:

suite on generic system image.

Mishaal:

Then underneath the broad CTS, there's also the compatibility test suite Verifi

Mishaal:

fire, which is a supplement to CTS with manual tests, such as those in another

Mishaal:

subset of tests called the image test suite, which test camera related stuff.

Mishaal:

So these tests that I mentioned are publicly available, but then there's

Mishaal:

also other stuff that Android partners have to run, including the bill test

Mishaal:

suite security test suite, which validates security patch, mergers.

Mishaal:

And then there's the Google test suite or GMs test suite, which test

Mishaal:

compliance with GMs requirements.

Mishaal:

You'll commonly see OEMs and Googlers refer to this whole entire series of tests

Mishaal:

as XTS, or like the X, like a lowercase X.

Mishaal:

And that's just like saying it's all the tests to keep things simple.

Mishaal:

So one thing I don't think many people are aware of or appreciate

Mishaal:

is just how big and comprehensive these automated test suites are.

Mishaal:

So in a recent blog post, when Google was announcing a new set of optional

Mishaal:

tests called CTS, D Google said that CTS today includes over 2 million tests.

Mishaal:

And that's just one of the test suites under XTS.

Mishaal:

I have heard that it takes a while to get through a full batch of tests, but I

Mishaal:

wanted to know, like, in your experience, just how long does it take to go through

Mishaal:

this process, actually doing a test.

Gary:

So we do have the ability to set up a pre test and that even

Gary:

that the CTS D is made to enable OEMs to have that power internally.

Gary:

A lot of it it's back and forth.

Gary:

We go ahead and run that on a slew of devices.

Gary:

So we'll have like an array of 10 to 15 devices that essentially are, are

Gary:

constantly running this pre CTS in house.

Gary:

And it's a lot of back and forth will end up catching failures.

Gary:

At the end of the day, a bug tracking ticket within our system.

Gary:

And then it goes to our system engineers and they go and fix those issues.

Gary:

And before it even gets to the three PL services, we have a

Gary:

certain confidence level on us being able to pass those tests.

Gary:

And because CTS is always evolving in every Android release, there's

Gary:

only so much you can catch in your pre CTS tests before it goes in.

Gary:

At that point, it's probably like one or two more, three PL.

Gary:

Tests for us to go back and then fix those issues.

Gary:

But overall, we've seen a lot of improvement on turnaround, you know,

Gary:

using those three PL vendors and that's improved quite a bit, uh, just cuz things

Gary:

are a lot more streamlined these days.

Gary:

So those things can vary, uh, and take as long as it's an approved house by

Gary:

Google and, uh, recommended you can pretty much fit that into your schedule

Gary:

and, and determine, you know, how long that, uh, back and forth should.

Gary:

It's a necessary evil the way I see it.

Gary:

But overall, I think it's useful to make sure that our product out of the door,

Gary:

uh, the factory meets a certain quality

Mishaal:

level.

Mishaal:

So are we talking hours days?

Mishaal:

What's the time scale here?

Mishaal:

Back and forth.

Mishaal:

Probably be

Gary:

weeks.

Gary:

Yeah.

Gary:

Okay.

Gary:

Wow.

Gary:

And then, yeah, I mean, initially, right?

Gary:

So there'll be ones that you run to a lot, but the incremental

Gary:

ones fall into days, I would say.

Gary:

But initially when you're trying to release a V one product, the

Gary:

brand new processor brand new.

Gary:

Uh, things that, you know, do compliment the whole, uh, GKI initiative.

Gary:

Like those type of things help a bit in streamlining it,

Gary:

project trouble also, right?

Gary:

Like that whole introduction of things that we've seen over the

Gary:

past five years has made it.

Gary:

So it's more streamlined and we have a bit more granularly control in, into

Gary:

updating each one of these modules.

Mishaal:

All right.

Mishaal:

Thank you for that.

Mishaal:

So for those of you who didn't get Gary's explanation of three

Mishaal:

S or still unsure of what they.

Mishaal:

It stands for third party labs.

Mishaal:

And they're basically firms that Google contracts certification testing

Mishaal:

out to instead of OEMs all sending their bills and devices to Google

Mishaal:

for certification testing, Google outsources, that two, three PLS.

Mishaal:

Jason mentioned that they used to have a direct line to submit

Mishaal:

their certification role to Google.

Mishaal:

But most companies aren't able to do that.

Mishaal:

And as sta said, awesome, isn't doing that.

Mishaal:

Now, what happens is you submit your device and build to three PL testing.

Mishaal:

And they verify that the bill passes and with compatibility

Mishaal:

tests and it passes XTS.

Mishaal:

And then once that is approved and that build is validated as passing

Mishaal:

all the requirements, then that build information and that build fingerprint

Mishaal:

are submitted to Google to add to their database of CTS certified bills.

Mishaal:

This database is what is used by GMs to verify that it's installed

Mishaal:

in a valid certified build.

Mishaal:

So if you try to just take a fresh AOSP build and integrate GMs into it, and you

Mishaal:

try to run the Google play store, it's a no, we're not running on this device.

Mishaal:

It's not validated.

Mishaal:

That's why a lot of these custom ROMs, they kind of spoof the build fingerprint

Mishaal:

to use a, uh, previously validated one.

Mishaal:

And that's why a lot of these spoofs have a repository of fingerprints to use.

Mishaal:

The CTS verified build fingerprint is also, what's used by the safety

Mishaal:

and at station API, which is actually being deprecated in a few

Mishaal:

years by the play integrity API.

Mishaal:

Basically this certified build is what Google approves the ship GMs on a product.

Mishaal:

And any other build, like if, if you have to do an update to a build, it's

Mishaal:

gonna have a new build fingerprint.

Mishaal:

And then that has to be certified.

Mishaal:

As Gary mentioned, it's the process is going be a bit shorter, but

Mishaal:

you still have to run through this process of doing the test.

Mishaal:

Again, validating again, sending your bill to third party labs for results.

Mishaal:

Yeah.

Mishaal:

It's a long and arduous process that repeats every time you need to do an

Mishaal:

update, if you kind of brought this up already, Jason, but essential was rather

Mishaal:

famous for shipping day one updates.

Mishaal:

And you haven't told Andrew police an interview that you literally

Mishaal:

got yelled at by Google for rolling out updates too quickly.

Mishaal:

You mentioned that briefly a bit about how that's possible, that you were able

Mishaal:

to bypass three PLS for testing, but was there anything else that enabled

Mishaal:

essential to roll it up it so quickly?

Mishaal:

No,

Jason:

I mean, it was really the team and the connection looked at, you know, Andy

Jason:

could make a call that nobody else could.

Jason:

Um, and so we're left now with being like everybody else and we, we will do

Jason:

our best to be as quick as possible.

Jason:

It's obviously a priority for us more so than a lot of other

Jason:

companies, because we're, our entire ethos has built around privacy.

Jason:

So, uh, that's where we stand.

Gary:

Yeah.

Gary:

And as a remote company, you know, we are a little bit tied

Gary:

to these three PL labs initially.

Gary:

I mean, we still have that dream of having that streamlined process.

Gary:

I think we're one hire in an office space away from doing

Gary:

that with Google's approval.

Gary:

That's something that I hope we eventually get to back, like as

Gary:

well, old machine sometime in 2023,

Mishaal:

right.

Mishaal:

Unfortunately, from what you've told me, Your software build

Mishaal:

actually pretty lean and it's not heavily customized from AOS P.

Mishaal:

So that should help with actually bringing up new software

Mishaal:

releases and integrating patches.

Mishaal:

And also with all the initiatives that Google's been introducing over the

Mishaal:

years, like product tr will generic kernel image GF, which I'll talk

Mishaal:

about a bit later, like, you know, all this has become significantly

Mishaal:

less resource intensive to, I.

Mishaal:

But there is one thing I kind of glossed over in the development life cycle.

Mishaal:

And it's a point that many people love to bring up when they argue,

Mishaal:

why updates are so slow to roll out.

Mishaal:

And it's what happens when carriers get involved.

Mishaal:

So for those of you don't know, carriers can involve themselves

Mishaal:

in many different ways.

Mishaal:

Each of them have their own needs.

Mishaal:

Some of them will ask for full framework changes to accommodate their asks.

Mishaal:

They might ask for specific branding changes, they might

Mishaal:

ask for custom boot animation.

Mishaal:

They might ask for custom icons, they might ask.

Mishaal:

The logo to be on the status bar or others will ask to insert

Mishaal:

specific apps, which Google

Jason:

refers.

Jason:

Yeah.

Jason:

And when you don't, they're gonna go, Hey, we're also gonna, we're

Jason:

not gonna put as much marketing.

Jason:

We're not gonna meet our end of the contract.

Jason:

I'm trying to think of the non four letter version word.

Jason:

Of my response to anything involving the carriers.

Jason:

Uh, so there is a reason why we're open market.

Jason:

We will be certified to use on all us and Canadian and EU and UK carriers.

Jason:

However, we have zero ties to any specific carrier directly.

Jason:

This is such a complicated topic from a sense of language that it, I, I want

Jason:

to be careful of the words I use here.

Jason:

Uh, so I'll just say our devices will work on all networks.

Jason:

However, we are not selling through any carrier.

Gary:

I think one interesting thing to note is maybe five years

Gary:

plus ago, the majority of sales came through carriers, right?

Gary:

Cause there's a heavy dependency on OEMs to have that quick pro

Gary:

type of relationship with carriers.

Gary:

I think now with the world climate, the way things are evolving, I think it's

Gary:

direct to consumer having this B Y O D.

Gary:

That opportunity is now a bit open for us to move as many devices as we need

Gary:

to as a, a lean company in general.

Gary:

So that type of relationship.

Gary:

Yeah.

Gary:

A lot of the stuff with carriers, they put a lot of blot wear on your device.

Gary:

That was completely against all of our ethos and our beliefs in a device

Gary:

is you shouldn't have this thing that you can't uninstall, essentially

Gary:

like too many things on there.

Gary:

Right?

Gary:

There's those necessary ones where that's just the nature of how Android behaves.

Gary:

But if now these large telecom companies are forcing some stuff to exist on there.

Gary:

There is some good, right?

Gary:

They do like visual voicemail stuff or different apps, um, things like that.

Gary:

But you know that there are things that people generally complain about.

Gary:

And if it's been long enough for us to stray away from being

Mishaal:

carrier dependent, well, you both kind of already answered the

Mishaal:

question I was gonna ask, which is what are your thoughts on carriers being

Mishaal:

blamed for delaying software rollouts?

Mishaal:

And I think you both played that kind of clear with your, uh, opinions.

Mishaal:

So, uh, before we move on on, you're

Mishaal:

completely

Jason:

responsible for it.

Jason:

It are so responsible

Jason:

for delays off the record.

Jason:

Uh, pick I'll go back on the record for this great example of a carrier.

Jason:

Just being completely asinine.

Jason:

There was a carrier in Japan.

Jason:

I don't remember which Japanese carrier it was.

Jason:

But to pass their mechanical requirement, you had to drop the phone on its

Jason:

edge from six feet onto the sharp edge of an IV without any damage.

Jason:

I could literally take a block of titanium, just solid titanium, and it

Jason:

will show a mark if I do that drop test.

Jason:

And then when you fail that test, they go, ah, well you need a waiver.

Jason:

Well, we're gonna wanna take like 3% off all your.

Jason:

Uh, whoa.

Jason:

I was like, like, there's nothing that passed that test.

Jason:

It's not possible.

Jason:

And they were like, no, no, we're gonna that that's our requirement.

Jason:

I feel like it's a

David:

test written by their underwriters.

Jason:

Oh, I'm sure it was written by a lawyer.

Jason:

Somewhere was like, Hey, come up with some tests that are impossible to pass.

Jason:

. Mishaal: Wow.

Jason:

And on that colorful note, we've just wrapped part one of our interview

Jason:

with Jason KES and Gary Anderson from awesome part two should be the

Jason:

next episode in this podcast feed.

Jason:

So make sure you give that a listen when you can.

Jason:

And if you're interested in building your own Android device for your

Jason:

business, come talk to us at ESER.

Jason:

We can help you work through how to choose the right hardware for your kiosk point

Jason:

of sale terminal or other fleet device, as well as how to remotely manage and keep

Jason:

them updated with our DevOps approach.

Jason:

Go to eser.io and schedule a chat with us today.

Jason:

We'd love to hear from you.

Jason:

And thanks for listening to this episode of Android bites.

Next Episode All Episodes Previous Episode

Listen for free

Show artwork for Android Bytes (powered by Esper)

About the Podcast

Android Bytes (powered by Esper)
A weekly show that dives deep into the Android OS
Android Bytes (powered by Esper) is the podcast that dives deep into the engineering and business decisions behind the world’s most popular OS. https://www.esper.io

Android powers over 3 billion devices worldwide and is the platform of choice for over a thousand companies. You’ll find Android on smartphones, tablets, watches, TV, cars, kiosks, and so much more. How does Google architect Android to run on so many form factors, and how do companies fork AOSP to make it run on even more devices? These are the kinds of questions the Android Bytes podcast considers each week.

Join cohosts Mishaal Rahman and David Ruddock, two journalists with extensive knowledge covering the Android OS platform and ecosystem, as they speak to system architects, kernel engineers, app developers, and other distinguished experts in the Android space.

Get in touch with us at Esper.io if you’re looking to use Android for your product — we have the experience you need.

About your hosts

David Ruddock

Profile picture for David Ruddock
David is the Editor in Chief of Esper, and cohosts Android Bytes. David spent over 10 years as the Editor in Chief of Android Police, where he reviewed more phones than he'd care to admit, broke dozens of exclusive mobile industry stories (and also, phones), and ran one of the web's most vibrant Android communities.

Mishaal Rahman

Profile picture for Mishaal Rahman
Mishaal is the Senior Technical Editor at Esper.io and a cohost of the Android Bytes podcast. At his previous role as Editor-in-Chief at XDA-Developers, Mishaal was at the forefront of Android tech journalism, breaking story after story on new OS features and platform changes.