Filter
-
Content Type
-
Category
Mobile/Wearable
Visual Display
Digital Appliance
Platform
Recommendations
Filter
Learn Code Lab
webcode lab code lab is an education platform that engages anyone to understand, through a series of topics, the entirety of the sdks and tools powered by samsung. all tags all tags in-app purchase add samsung in-app purchase service to your app 30 mins start watch face studio get creative with weather data in watch face studio 30 mins start sdc24 health build a health app with steps from samsung health and its connected wearables 30 mins start sdc24 health access rich sleep data from samsung health measured by galaxy wearables 30 mins start sdc24 smartthings create a smartthings edge driver for an iot bulb 30 mins start sdc24 smartthings develop a smartthings find-compatible device 30 mins start sdc24 smartthings test edge drivers using smartthings test suite 30 mins start sdc24 health research stack establish a health research system using samsung health research stack 30 mins start sdc24 samsung pay samsung wallet integrate samsung pay web checkout with merchant sites 30 mins start sdc24 samsung pay samsung wallet integrate samsung pay sdk flutter plugin into merchant apps for in-app payment 30 mins start sdc24 samsung wallet utilize add to samsung wallet service for digital cards 30 mins start sdc24 samsung wallet verify your id with samsung wallet 30 mins start sdc24 automotive create an android automotive operating system (aaos) app with payments via samsung checkout 30 mins start watch face studio apply gyro effects to a watch face using watch face studio 20 mins start sdc23 smartthings matter: create a virtual device and make an open source contribution 25 mins start sdc23 smartthings matter: build a matter iot app with smartthings home api 25 mins start sdc23 galaxy z develop a widget for flex window 25 mins start sdc23 samsung pay samsung wallet integrate in-app payment into merchant apps using samsung pay sdk 30 mins start sdc23 gamedev optimize game performance with adaptive performance in unity 30 mins start sdc23 gamedev galaxy z implement flex mode into a unity game 30 mins start sdc23 watch face studio customize styles of a watch face with watch face studio 30 mins start sdc23 watch face studio galaxy z customize flex window using good lock plugin on watch face studio 20 mins start sdc23 health measure skin temperature on galaxy watch 20 mins start sdc23 health transfer heart rate data from galaxy watch to a mobile device 30 mins start watch face studio design a watch face using mask and moon phase tags 30 mins start sdc22 bixby smartthings control a smart bulb 30 mins start sdc22 watch face studio apply conditional lines on watch faces 20 mins start sdc22 health measure blood oxygen level on galaxy watch 30 mins start sdc22 health measure blood oxygen level and heart rate on galaxy watch 40 mins start sdc22 galaxy z implement multi-window picture-in-picture on a video player 20 mins start sdc22 samsung blockchain transfer erc20 token with blockchain app 45 mins start sdc22 galaxy ar emoji gamedev use ar emoji on games and 3d apps 60 mins start sdc22 gamedev galaxy z implement flex mode on an unreal engine game 120 mins start sdc22 smartthings integrate iot devices into the smartthings ecosystem 45 mins start health create a daily step counter on galaxy watch 40 mins start health track deadlift exercise on galaxy watch 40 mins start watch face studio create a watch face using tag expressions 60 mins start galaxy z implement flex mode on a video player 30 mins start galaxy z implement app continuity and optimize large screen ui of a gallery app 40 mins start galaxy z configure an app to enable copy and paste in multi-window 30 mins start galaxy z configure an app to enable drag and drop in multi-window 30 mins start galaxy s pen remote implement keyevent.callback by mapping air actions 30 mins start galaxy s pen remote handle s pen's raw data 30 mins start samsung blockchain develop a secure blockchain app 40 mins start samsung blockchain develop a blockchain shopping app 40 mins start
announcement web
blogour strategic partnership with browserstack gives you six months' free access to their real device cloud to test in samsung internet our strategic partnership with browserstack gives you six months' free access to their real device cloud to test your websites on samsung internet click here to find out more from the browserstack website. debugging mobile devices can be a real pain compared to debugging desktop browsers. when you want to start testing on many devices this process can get even more infuriating, including juggling usb-c cables, micro usb and lightning cables, and, ensuring your testing devices are charged and updated. if you want to get serious about mobile testing you need to set up a full device lab which requires a significant amount of investment. once you have set up a wide range of testing devices, next you need to set up your browsers to test on. so which browsers do you pick to test? photo of a device testing wall from google io 2015 photo © ada rose cannon with over half a billion active users as of march 2021, samsung internet is a browser to be reckoned with. and yet, testing on samsung internet is not as mainstream as, say, chrome or safari. our latest partnership with browserstack is all set to change this. all you have to do is sign up and start testing. mobile browser market share in europe — march 2021 real devices make all the difference samsung internet is the default browser for samsung devices but can be used on all android devices. it is a fork of chrome maintained by samsung that allows us to add enhancements to meet the need of samsung's power users. though we try to maintain as much compatibility with mainline chromium, there may be some unexpected issues. this makes it incredibly important to test and debug on samsung internet in addition to other popular mobile browsers on real devices for real-world results. samsung internet can be debugged through adb (android device bridge) and chrome://inspect just like mobile chrome. but there is a more convenient route to debugging on samsung internet than plugging a device into your computer, which is to test and debug on real devices instantly with browserstack. browserstack is the world's leading testing platform that provides instant access to 2,000+ real mobile devices and browsers and is used by over 2 million developers worldwide. samsung internet and browserstack's exclusive partnership gets you six months of unlimited free testing on samsung devices, giving you the perfect environment to test samsung internet. testing on samsung internet with browserstack browserstack allows you to test on samsung internet on real devices. you need to sign up to start debugging on real devices streamed to your browser. first sign up here, for the exclusive free trial, giving you six months' free access to test on samsung internet on browserstack's real device cloud. free samsung internet testing on browserstack next, open up browserstack's live dashboard to select the samsung device you would like to use with samsung internet. the device will open up in your desktop browser letting you interact with the remote mobile browser using your mouse and keyboard. you can test sites running on localhost by downloading the browserstack local binary can forward a local http server to be accessed by devices on browserstack. samsung internet is available on all android devices on android l or greater. to test on these devices you can select the device on the dashboard. samsung internet is an incredibly popular browser and thanks to browserstack, testing is easier than ever before. there is no reason not to start testing today. free samsung internet testing on browserstack
Ada Rose Cannon
Learn Code Lab
codelabtransfer heart rate data from galaxy watch to a mobile device objective create a health app for galaxy watch, operating on wear os powered by samsung, to measure heart rate and inter-beat interval ibi , send data to a paired android phone, and create an android application for receiving data sent from a paired galaxy watch overview with this code lab, you can measure various health data using samsung health sensor sdk and send it to a paired android mobile device for further processing samsung health sensor sdk tracks various health data, but it cannot save or send collected results meanwhile, wearable data layer allows you to synchronize data from your galaxy watch to an android mobile device using a paired mobile device allows the data to be more organized by taking advantage of a bigger screen and better performance see samsung health sensor sdk descriptions for detailed information set up your environment you will need the following galaxy watch4 or newer android mobile device android studio latest version recommended java se development kit jdk 17 or later sample code here is a sample code for you to start coding in this code lab download it and start your learning experience! heart rate data transfer sample code 213 7 kb connect your galaxy watch to wi-fi go to settings > connection > wi-fi and make sure that the wi-fi is enabled from the list of available wi-fi networks, choose and connect to the same one as your pc turn on developer mode and adjust its settings on your watch, go to settings > about watch > software and tap on software version 5 times upon successful activation of developer mode, a toast message will display as on the image below afterwards, developer options will be visible under settings tap developer options and enable the following options adb debugging in developer options find wireless debugging turn on wireless debugging check always allow on this network and tap allow go back to developer options and click turn off automatic wi-fi notethere may be differences in settings depending on your one ui version connect your galaxy watch to android studio go to settings > developer options > wireless debugging and choose pair new device take note of the wi-fi pairing code, ip address & port in android studio, go to terminal and type adb pair <ip address> <port> <wi-fi pairing code> when prompted, tap always allow from this computer to allow debugging after successfully pairing, type adb connect <ip address of your watch> <port> upon successful connection, you will see the following message in the terminal connected to <ip address of your watch> now, you can run the app directly on your watch turn on developer mode for health platform to use the app, you need to enable developer mode in the health platform on your watch go to settings > apps > health platform quickly tap health platform title for 10 times this enables developer mode and displays [dev mode] below the title to stop using developer mode, quickly tap health platform title for 10 times to disable it set up your android device click on the following links to setup your android device enable developer options run apps on a hardware device connect the galaxy watch with you samsung mobile phone start your project in android studio, click open to open an existing project locate the downloaded android project hrdatatransfer-code-lab from the directory and click ok you should see both devices and applications available in android studio as in the screenshots below initiate heart rate tracking noteyou may refer to this blog post for more detailed analysis of the heart rate tracking using samsung health sensor sdk first, you need to connect to the healthtrackingservice to do that create connectionlistener, create healthtrackingservice object by invoking healthtrackingservice connectionlistener, context invoke healthtrackingservice connectservice when connected to the health tracking service, check the tracking capability the available trackers may vary depending on samsung health sensor sdk, health platform versions or watch hardware version use the gettrackingcapability function of the healthtrackingservice object obtain heart rate tracker object using the function healthtrackingservice gethealthtracker healthtrackertype heart_rate_continuous define event listener healthtracker trackereventlistener, where the heart rate values will be collected start tracking the tracker starts collecting heart rate data when healthtracker seteventlistener updatelistener is invoked, using the event listener collect heart data from the watch the updatelistener collects datapoint instances from the watch, which contains a collection of valuekey objects those objects contain heart rate, ibi values, and ibi statuses there's always one value for heart rate while the number of ibi values vary from 0-4 both ibi value and ibi status lists have the same size go to wear > java > data > com samsung health hrdatatransfer > data under ibidataparsing kt, provide the implementation for the function below /******************************************************************************* * [practice 1] get list of valid inter-beat interval values from a datapoint * - return arraylist<int> of valid ibi values validibilist * - if no ibi value is valid, return an empty arraylist * * var ibivalues is a list representing ibivalues up to 4 * var ibistatuses is a list of their statuses has the same size as ibivalues ------------------------------------------------------------------------------- * - hints * use local function isibivalid status, value to check validity of ibi * ****************************************************************************/ fun getvalidibilist datapoint datapoint arraylist<int> { val ibivalues = datapoint getvalue valuekey heartrateset ibi_list val ibistatuses = datapoint getvalue valuekey heartrateset ibi_status_list val validibilist = arraylist<int> //todo 1 return validibilist } check data sending capabilities for the watch once the heart rate tracker can collect data, set up the wearable data layer so it can send data to a paired android mobile device wearable data layer api provides data synchronization between wear os and android devices noteto know more about wearable data layer api, go here to determine if a remote mobile device is available, the wearable data layer api uses concept of capabilities not to be confused with samsung health sensor sdk’s tracking capabilities, providing information about available tracker types using the wearable data layer's capabilityclient, you can get information about nodes remote devices being able to consume messages from the watch go to wear > java > com samsung health hrdatatransfer > data in capabilityrepositoryimpl kt, and fill in the function below the purpose of this part is to filter all capabilities represented by allcapabilities argument by capability argument and return the set of nodes set<node> having this capability later on, we need those nodes to send the message to them /************************************************************************************** * [practice 2] check capabilities for reachable remote nodes devices * - return a set of node objects out of all capabilities represented by 2nd function * argument, having the capability represented by 1st function argument * - return empty set if no node has the capability -------------------------------------------------------------------------------------- * - hints * you might want to use filtervalues function on the given allcapabilities map * ***********************************************************************************/ override suspend fun getnodesforcapability capability string, allcapabilities map<node, set<string>> set<node> { //todo 2 } encode message for the watch before sending the results of the heart rate and ibi to the paired mobile device, you need to encode the message into a string for sending data to the paired mobile device we are using wearable data layer api’s messageclient object and its function sendmessage string nodeid, string path, byte[] message go to wear > java > com samsung health hrdatatransfer > domain in sendmessageusecase kt, fill in the function below and use json format to encode the list of results arraylist<trackeddata> into a string /*********************************************************************** * [practice 3] - encode heart rate & inter-beat interval into string * - encode function argument trackeddata into json format * - return the encoded string ----------------------------------------------------------------------- * - hint * use json encodetostring function **********************************************************************/ fun encodemessage trackeddata arraylist<trackeddata> string { //todo 3 } notetrackeddata is an object, containing data received from heart rate tracker’s single datapoint object @serializable data class trackeddata var hr int, var ibi arraylist<int> = arraylist run unit tests for your convenience, you will find an additional unit tests package this will let you verify your code changes even without using a physical watch or mobile device see the instruction below on how to run unit tests right click on com samsung health hrdatatransfer test , and execute run 'tests in 'com samsung health hrdatatransfer" command if you have completed all the tasks correctly, you will see all the unit tests pass successfully run the app after building the apks, you can run the applications on your watch to measure heart rate and ibi values, and on your mobile device to collect the data from your watch once the app starts, allow the app to receive data from the body sensors afterwards, it shows the application's main screen to get the heart rate and ibi values, tap the start button tap the send button to send the data to your mobile device notethe watch keeps last ~40 values of heart rate and ibi you’re done! congratulations! you have successfully achieved the goal of this code lab now, you can create a health app on a watch to measure heart rate and ibi, and develop a mobile app that receives that health data! if you face any trouble, you may download this file heart rate data transfer complete code 213 9 kb to learn more about samsung health, visit developer samsung com/health
Learn Code Lab
codelabestablish a health research system using samsung health research stack objective learn how to create a health research system that collects data from mobile and wearable devices and visualizes the collected data in a web portal using samsung health research stack overview samsung health research stack is an open-source toolset that helps collect and analyze data from devices in android and wear os environments it provides tools and infrastructure for developing and deploying health studies, ranging from medical research to clinician services and more the framework consists of four components backend services - offers api endpoints to access and interact with a robust data engine web portal - a customizable interface for creating surveys, managing team members, tracking subjects, and analyzing data app sdk - an sdk for building android and wear os apps capable of collecting data from wearable devices starter app - a health research app with mobile and wearable versions created using basic features provided by the app sdk for detailed information, see samsung health research stack set up your environment you will need the following android studio latest version recommended samsung galaxy mobile device with updated health connect app and samsung health app installed samsung galaxy watch synced to the mobile device docker desktop sample code to start your learning experience, download the project files of the samsung health research stack starter mobile and wearable app notedepending on your preferred development style, you can either download or clone the repository of the project files to your local computer feel free to edit and customize this project for your own purposes, including this code lab activity set up your galaxy mobile and watch device connect your galaxy mobile device to your pc and enable adb debugging next, connect your galaxy watch to android studio over wi-fi lastly, enable the developer mode of the health platform app on your watch by following these steps a go to settings b tap on apps c select health platform d quickly tap on health platform several times until [dev mode] appears notethe samsung health developer mode is only intended for testing or debugging your application it is not for application users deploy the backend and web portal locally download the backend-config-files zip file and unzip it the folder contains the docker-compose yaml file open the terminal window of docker desktop in the terminal, go to the directory where your docker-compose yaml file is located, and run the following command $ docker compose up –d the script deploys the backend and the web portal to your local computer, and it includes 6 services redis - redis watcher for the backend casbin service mongo - for saving data from the backend postgres - for supertokens database and the backend casbin database supertokens - for username and password authentication backend - backend for the samsung health research stack portal - web portal for the samsung health research stack you can change the port number, username, and password for each database with the default setting, you can access the web portal in your browser at localhost 80 the script file has simple settings for easy deployment to add more features, you can change the environment in the docker-compose yaml file's services > backend > environment part set the aws environment variables optional you can enable uploading and downloading features by setting the following aws environment variables aws_bucket_name aws_region aws_access_key_id aws_secret_access_key aws_session_token you can follow the instructions in using the default credential provider chain for setting up aws credentials set google openid connect optional to enable google openid connect oidc login, you can set the following environment variables oidc_google_oauth2_url default "https //oauth2 googleapis com" oidc_google_client_id oidc_google_client_secret oidc_google_redirect_uri you can refer to openid connect for more information about setting google oidc create a new study the health research system has two user groups investigators - conduct research studies and use the web portal for managing studies and analyzing data subjects - participate in studies by answering surveys and performing tasks through the mobile app, as well as collecting health data from wearable apps to start your research study, as an investigator, follow the steps below create an account and sign in to the web portal page you deployed fill out the form with your information on the study collection page, click the create study button noteall enrolled investigators can create a study the creator becomes the study admin in the basic info tab, input the details of the study 5 for the study scope, choose public noteyou can set the study scope as either public or private if you choose private, you need to input a participation code that subjects must enter into the mobile app to join however, for the ease of testing in this code lab, it is recommended to set the scope as public for the study requirements field, you can input any text and click next go to participation requirements tab and select the data types to collect in wear category for this code lab, choose wear accelerometer wear ecg wear heart rate the logo and title of the created study show on the study collection page connect the mobile app to backend system to connect the starter mobile app to the backend system, follow these steps noteto ensure that the galaxy mobile device can connect to the machine where the backend system is deployed, it is recommended to connect both the machine and the mobile device to the same network open the downloaded project file in android studio and go to samples > starter-mobile-app in the local properties file, set the server_address to the ip address of the machine where the backend system is deployed server_address ="input ip address here" tipyou can check your ip address using the command line windows in command prompt, type ipconfig and find the ip address under ipv4 address mac in terminal, type ifconfig and look for the ip address under inet next to en0 next, set the server_port to 50001 if you used the default values in the provided docker-compose yaml file for deployment if not, use the port number you set server_port=50001 set authentication method the app sdk supports three types of authentication methods for registration samsung utilizes samsung account cognito incorporates amazon cognito authentication super-tokens enables anonymous login to allow research participants to register and log in using their personal emails, set the sign_in_mode as super-tokens in the local properties file sign_in_mode="super-tokens" upload wearable data via grpc when synchronizing wearable device data, the app sdk offers two approaches utilizing grpc for high-performance remote procedure calls or synchronization through files each approach has advantages and disadvantages regarding factors such as battery life and server workload however, it is advisable to utilize grpc during local development to configure the mobile application to upload wearable data via grpc rather than files, add the following code in the local properties file enable_upload_wearble_data_by_file=false show the sync button in starter wearable app after configuring the mobile app, modify the wearable app to meet the requirements of your study go to samples > starter-wearable-app and open the local properties file the wearable app features a sync button, which can be displayed or hidden when this button is pressed, it synchronizes the collected data with the backend system instantly to show the sync button, set the value of enable_instant_sync_button as below enable_instant_sync_button=true notethis instant sync feature can negatively affect the battery consumption of both apps, so it is recommended to remove the sync button when you publish your app the samsung health research stack has an optimized data synchronization process that minimizes battery consumption set data measurement parameters you can customize the data collection and storage process of the wearable app by setting the values of the following data measurement parameters passive_data_insert_interval_in_seconds sets the data measurement buffer the buffer saves data in an in-memory database before the interval expires then, at regular intervals, the data from the buffer is stored in persistent memory data_split_interval_in_millis specifies the size of segmented data in persistent memory if these values are not specified, the wearable app uses its default values to verify that the data is being measured and synchronized instantly, you can set the values as follows passive_data_insert_interval_in_seconds=12 data_split_interval_in_millis=30000 run the starter mobile and wearable app after configuring the local properties of both starter apps, build and run your app in android studio by following these steps run the starter mobile app select your mobile app starter-mobile-app from the run configurations menu in the toolbar choose a connected galaxy mobile device as the target device for running the app click run to install the app after installation, clear the app's data run the starter mobile app follow the same steps as for the starter mobile app but select starter-wearable-app instead choose a connected galaxy watch device for running the app allow the app to access physical activity, sensor data, and send notifications when prompted ensure that the galaxy watch is connected with the galaxy mobile device register and join a study since you have set super-tokens as the authentication method, you can now register and log into the app at once open the starter mobile app and sign up with an unregistered email address after logging in and accepting permissions, the app displays the study you created from the web portal tap on the study card to view its details and click join study noteif a study is set to private and you wish to join it, press enter the study code located at the top of the screen and input the assigned participation code in the study code field agree to data collection and terms of research you can see that the sensor data to be collected are dependent upon the selection made in the web portal while creating the study sign and click next to complete the study onboarding process measure and collect health data in the starter wearable app, you can see a list of on-demand measurements that you can contribute to health research for this code lab, choose ecg and click measure follow the onscreen measurement instruction after measuring successfully, scroll to the bottom of the wearable app and press the sync button to synchronize the data with the mobile app in the mobile app, go to data tab, click the more button, and click sync to transfer the collected data to the web portal visualize the collected data in web portal you can display the collected data as a graph in any way you choose for further analysis of the study from the overview page of the study in the web portal, navigate to the dashboard page click on the add chart button provide a title for the chart and select the desired chart type then, edit the chart source choose the database where the data is stored for this code lab, enter the following query to display only the first ten heart rate data from wearheartrate table select * from wearheartrate limit 10 click run query and save select value and timestamp for the value and category columns respectively check the preview of the graph finally, click save to display the graph into the dashboard you're done! congratulations! you have successfully achieved the goal of this code lab now, you can create your own health research system by yourself! to learn more, see samsung health research stack
Learn Developers Podcast
docseason 3, episode 7 previous episode | episode index | next episode this is a transcript of one episode of the samsung developers podcast, hosted by and produced by tony morelan a listing of all podcast transcripts can be found here host tony morelan senior developer evangelist, samsung developers instagram - twitter - linkedin guests guy merin, senior director of engineering, surface duo developer experience, microsoft ade oshineye, senior staff developer advocate, google søren lambæk, developer relations engineer, samsung foldables, games not only do we chat about the emerging trends in the foldable industry but how companies are working together to help developers create for this new and innovative technology listen download to this episode topics covered foldable industry trends growth of foldables target audience making foldables mainstream benefits of the foldable form factor extending a traditional app to a foldable device process for supporting foldables foldable device example apps consumer adoption challenges developer opportunities resources for developers companies working together on foldables helpful links large screen/foldable guidance large screen app quality jetpack windowmanager jetpack slidingpanelayout jetpack windowmanager foldable/dual-screens surface duo layout libraries surface duo android emulator figma - surface duo design kit surface duo blog surface duo twitch surface duo twitter adopting native language discover quality apps on large screens foldables design/development perspectives learn about foldables case studies 5 steps to large screen designing understanding layout code lab testing window size classes jetnews different screen sizes migrate to responsive layouts compose/activity embedding unfolding gaming potential samsung remote test lab samsung developer program website samsung developer program newsletter samsung developer program blog samsung developer program news samsung developer program facebook samsung developer program instagram samsung developer program twitter samsung developer program youtube samsung developer program linkedin tony morelan linkedin guy merin, microsoft, linkedin ade oshineye, google, linkedin søren lambæk, samsung, linkedin transcript note transcripts are provided by an automated service and reviewed by the samsung developers web team inaccuracies from the transcription process do occur, so please refer to the audio if you are in doubt about the transcript tony morelan 00 01 hey, i'm tony morelan and this is the samsung developers podcast, where we chat with innovators using samsung technologies, award winning app developers and designers, as well as insiders working on the latest samsung tools welcome to season three, episode seven recently i hosted a roundtable discussion on developing for foldable devices not only do we chat about the emerging trends in the foldable industry, but how companies are working together to help developers create for this new and innovative technology enjoy today's show, we're doing something pretty special i've got three guests on the podcast all from leading companies in the foldable space i've got guy merin, senior director of engineering on the surface duo developer experience team at microsoft guy merin 00 53 hi tony, good morning great to be here tony morelan 00 55 excellent i've also got ade oshineye, senior staff developer advocate at google ade oshineye 01 00 hi nice to be here tony morelan 01 03 and i've also got søren lambæk, developer relations engineer at samsung søren lambæk 01 09 hello good to be here tony morelan 01 11 this is amazing i've got all of you on the podcast at the same time we actually haven't tried this format before so let's take him for a ride and see how much fun we can have let me start with guy over at microsoft tell me who is guy merin? guy merin 01 25 hey, yeah, hey, folks so i'm guy the journey in microsoft a few years back started that windows went through the windows mobile, because mobile gadgets and devices are really my passion and then the last five or so years, i've been working full time on android, building a couple of software products, and recently the surface duo so this mobile and android is really my passion and i'm really at my dream job now working with developers, you know, reaching out really great on the personal level, i got recently into mountain climbing so just last weekend, we had a big expedition to summit, one of the washington mountains i live in seattle in washington, okay and that was a very, very fun experience that i found a lot of similarities to, you know, projects we have at work, climbing a mountain and summit thing is really a project on its own with preparation and planning and found a lot of interesting similarities tony morelan 02 29 it gives you a lot of time to think also, i'm sure that when you're climbing so are you like with ropes and rappelling or yeah, rope really guy merin 02 38 is, is more snow so it's ropes and ice axes and stuff but oh, gosh tony morelan 02 45 that is great how many feet would you say? was the summit? guy merin 02 50 close to 11,000 tony morelan 02 52 wow, that is absolutely impressive what was your journey to get to the state of washington? were you born there? or is this? the accent i'm picking up? i'm not quite sure is from the northwest? guy merin 03 07 no, no so no, i was born and raised in israel okay and i moved over to washington eight years ago, i've been working at microsoft in israel, actually doing some fun stuff with windows phone in israel and then pretty much my wife wanted to move over to seattle and that that made us take the trip and we love it here tony morelan 03 32 so now let's move over to google tell me who is ade oshineye? ade oshineye 03 38 so i work in android developer relations i've worked all over the different aspects of google over the last 15 years before that was in consultancy, when i'm not at a desk in front of cameras and things i'm out with a camera, taking photos in zurich, where we have really nice mountains that i like to climb them by sitting in a train that just gently takes you to the top and then i also play badminton and play go so between that i'm pretty busy i tony morelan 04 05 wonder if i understand you actually were born and raised in england is that correct? yes ade oshineye 04 09 so i'm an east londoner but now i live in switzerland, which is strange and very different to east london but i also live in the middle of a whole collection of british shops, so that i can get british food very easily really? okay yes tony morelan 04 27 tell me how did you get involved with foldables at google? ade oshineye 04 30 well, let's see well, me specifically, i mean, i started out with the samsung flip and then we've got this planet of surface duo for us as a company, it's more around the whole beat together not the same idea that the point of the entity ecosystem is that all of these oem can try different things users can try different kinds of experiences developer can try to serve all of them and we power all of that with the platform tony morelan 04 57 and from samsung tell me who is søren lambæk? søren lambæk 05 02 hello, i work at samsung as a developer relations engineer and basically, i building relationships between the games industry and samsung there are so many mobile games out there so we were reaching out to them at a technical level and try to help their games to run smooth on certain devices on a more personal level, i am one of those artists that just got obsessed with programming sure so my background is actually a lot of with art, drawing and music and that kind of thing but i just could see, the programming hat was so powerful so i just, i got this obsession is programming tony morelan 05 48 excellent and i know that you guys can't see on the podcast but soren has some beautiful guitars behind him and before we hit the record button, we were all having a nice conversation about music now, i understand you were born in chile, but raised in england that correct søren lambæk 06 04 and so i was born i was born in chile that's correct and i was raised up in denmark, hence my name and my name is danish and okay because then i guess such a small country and at the time, i wanted to do get a career we didn't have any games industry in denmark so i decided i wanted to go to england and when university studying games design, because there was art, but then i realized programming that's where the future is, for me and then so i was one of the only students that went from art to programming is usually the other way around yeah, tony morelan 06 47 so yeah, i would definitely think so so let's talk foldables back in 2019, samsung released the galaxy fold, which was the first foldable device to really hit the mainstream market since then, other companies like microsoft, motorola, huawei, have released foldable devices and in such a short amount of time, we've seen some really great improvements with this technology guy, you've been from microsoft, what are some of the trends that you've noticed in the foldable industry? guy merin 07 17 some of the trends one we're seeing, as you said, more, more oems picking those up? are you seeing more and more companies bringing for the world? and it's really starting to become a commodity but the cool thing about it that each one has their own different angle to it so you know, for the microsoft one, it's, you know, mainly around productivity and two screens, for others is mainly around more real estate or something that is a small form that can then go to, to a bigger form and it's all really about the form factors and the posters that you can really do with it so how does the phone react when it's folded when it's open when it's tilted 90 degrees? and i think we'll see more of those in the future tony morelan 08 07 are they are you seeing different trends for the way developers are designing and building apps? ade oshineye 08 12 so i think we're seeing three main trends one is the oems exploring the space of possible designs, does the device folding fold out full vertically filled horizontally full three times, there's so many different things oems are doing second stylus is becoming more and more mainstream, that's changing the set of available postures and then the final thing is the way keyboards and trackpads are blurring the distinctions between phones, phablets tablets so the whole notion of what is an android app is becoming this flexible, multi-dimensional space and there's always people exploring that space and trying new things yeah, tony morelan 08 55 yeah soren, what about the growth in this industry? is this been something that you think, you know, over the past several years, it's really been, you know, going much higher? søren lambæk 09 04 yeah so last year, we had 150% growth, and we are expecting that in the future, more and more people seem to get foldable phones and when it comes to games, it does have like quite a lot of benefits because you can use the second screen if you're put it in like a folder but sure you can you can change this from full screen to a two completely different mode where the bottom screen, you can use it for items or mini map and that kind of thing tony morelan 09 35 yeah, yeah you know, this technology is so new that it's at this time, i think we're still trying to figure out what is this this target audience a day? what are your thoughts on who is the target audience for foldables? ade oshineye 09 49 well, i think a good way of thinking about it would be to look at the flips and the surface drill as capturing the two sets of ordinances we see there are very often younger people woohoo, looking for cool new experiences, i tend to see a lot of those people walking around with a samsung flip but then you also see a set of people at the high end with a lot more money tend to be more business people, they tend to have the larger the fold or a duel or something like that, that has a stylus that runs multiple apps at the same time, that sort of almost a replacement laptop and those are the two sets of people i tend to see using foldables tony morelan 10 25 guy, do you have any thoughts on them? on the demographic of who is attracted to foldables? guy merin 10 31 i don't see it as a demographic thing i think i think it will become a commodity that more and more users across the world will? we'll see i think right now we're still seeing trends, because he's on the higher end, of course, yeah so we're seeing trend around there but when this becomes more of a commodity, and i think it will, and more of a mainstream device, i don't think it's going to be a demographic thing, just like we've seen with other form, form factors that are spread across the world tony morelan 11 00 yeah, yeah in certain you'd mentioned about gamers and tell me your thoughts on you know why something like foldable device would be attracted to the gaming community? søren lambæk 11 09 well, obviously, a big screen will have a big effect, not only can you see like a lot of graphics do you like and can change and you can have like, a different benefits doing tony morelan 11 20 that so what would it take for foldables to become more mainstream? søren lambæk 11 24 the price is it's a major one for reforms are quite pricey sure, reducing the price wouldn't make it more accessible for a lot of people tony morelan 11 34 yeah and i also think that really trying to teach developers how to build apps, you know, more education on app adoption is also important søren lambæk 11 43 yeah, definitely, we see a lot of games developer don't even consider foldable phones yet so i hope that is something that is going to change, where they could like start maybe changing the ui before they actually building the game guy merin 11 58 i think it would only if i may add one thing i think it's is a triangle of three things there is, you know, the users and the users’ need to see the benefit of why they should, you know, try a foldable phone or a large screen and then what drives that is apps so the more apps that we see that utilize it, that gives them benefits over using just a single screen, smaller device, the more apps that will use things like side by side or split screen or drag and drop between and just productivity and thinks that users can get more out of these apps when running on these new form factors i think that's another key factor and i think the third piece of this triangle is, in order to make the app better on those, you need to support it, that sdk level and the platform yeah, that's a lot of work that has been done by everybody here so mainly by google, because they of course, own the platform so the more we will see those things as standard like jetpack compose so how do you support foldables? there? how do you support all the other sdks, the more they will come native, the better the apps will get, the better the users will benefit from them? and i think that triangle, doing it correctly, will make it much more mainstream in the future ade oshineye 13 20 i agree with that i think one other thing that we've been pushing is getting developers across the chasm of thinking about this so we have a code lab, we put together with microsoft shows developers how to build for a world where the devices can be radically different sizes i mean, on my desk here, i have a samsung flip and a samsung ultra and they are radically different sizes, one of them can fold to be even smaller so if you want to build for both of these devices, and all the things in between, you have to think about am i going to be a responsive design app or when adaptive app, i had to think about which layouts i'm going to support which postures are going to support which aspect ratios, which resolutions, and developers for a long time, we've been able to sort of not really think very hard about that because most phones for a long time were fairly similar sizes now, the same kindle app that has to fold nicely on a surface duo has to also work on a giant tablet, for example, we have duo and meet and the same apk more or less that runs on your phone also runs on your television when we think of this as large screens, the screens can be very tony morelan 14 35 large what about google's quality guidelines? so the challenge for ade oshineye 14 39 us with quality guidelines is we don't want to stifle innovation but we do want to make sure that when a user downloads an app from our store, that it works well on the device, and that there are there's a well-lit path for developers in how do i give users the best possible experience so we have fatal guidelines and implemented shouldn't advice on what is a high-quality experience and then we have tiers of quality, so that you don't have to take a big jump, you don't have to eat the elephant in one bite you can, i think it's eat the rhinoceros in one bite, you can do it in, in lots of little bites so there are steps you can take to improve your quality and we have an easy-to-understand website that shows you, here's all the things you haven't done yet and you can decide which ones to invest in and when tony morelan 15 29 yeah, and i'll mention here that i know throughout this podcast that you guys will be referencing lots of resources for developers to really learn more about how to create for foldables, i'll be sure to include links in the show notes so that you guys can easily find this content so guy, tell me who do you think would benefit by developing for the foldable form factor and why guy merin 15 52 i think everybody will benefit from it the bottom of the funnel is the apps and the user so the users would benefit the most but i think you're asking more about the developers, i think every developer should look at is how they said here before my app is not going to run now only on a single screen, small device, it will span across others, every developer should think about their app what else can i do now that i have more real estate? and again, if it's a game, okay, what do i do with the second screen? how will my game maybe if i run the game, in a split screen with discord on the other side, because i'm using that for gaming as well, to start thinking about all these new scenarios that your app can now do? how can i provide content to the app that sits just beside me with drag and drop functionalities with these kinds of things? and i think every app, every developer, can benefit from those and you should start thinking about that, because this is preparing for, for the future and for more and more of these devices showing in market yeah, tony morelan 17 02 and i know the other day, a day and i were actually having a conversation about multi app user journeys ade oshineye 17 08 so we've tried to move away from thinking of use cases or scenarios to what we call cjs critical user journeys and part of that is because if i'm at home during the pandemic, i tend to have google docs open with meeting notes and then google meat open that if you move that to a foldable, well, that's one screen each but then i need to drag and drop things across them which means both developers need to think, am i a good citizen? does my app play well with others? historically, developers have tended to think about the user journey only within their own app but if you're a video chat app, you need to think okay, how do i work well, with a game with video content, somebody's watching, if i'm a video app, do i have picture in picture, if i have picture and picture, it unlocks all sorts of interesting new user journeys for the user if i'm a game, and i support multi window scenarios, it becomes possible somebody to play a game and live, stream it or play a game and have a chat conversation going on at the same time so trying to think about the user journey that's not just inside your one app, but it's across your app and other apps or even across multiple instances of your app tony morelan 18 17 store and tell me, what should the developer with an existing app do to extend it to foldables? søren lambæk 18 23 so there's quite a lot of sdk is that can be used already jetpack? windows manager is an android library that can help you with detecting if your app is expanding over multiple screens or not tony morelan 18 39 what about specifically game developers? maybe someone who's developing, you know, for unity or for unreal? are there resources out there to help them? søren lambæk 18 47 yeah, so samsung got like, some tutorials that will help you to set up phone apps for unity and unreal, boston guy merin 18 56 tony, if i may i can add one thing on the first question, what can developers do with an existing app, we put up a three-step guide and it's not specifically for the microsoft surface device for large screen on older foldables and the really the three steps are crawl, walk, run so you should start with taking your app and just trying it out on these new form factors if you have access to one of these devices, just try it there if you don't, there is emulators for everything for foldables for a duo for a large screen so just try your app on the emulator that's step one just see that it behaves well on these new form factors using an email lender step two is what we call the low hanging fruit so don't super invest but start small, as they say, maybe think about how can my app behave when it's running within other apps? so maybe support drag and drop either is a source of or is or is a destination cause doing picture and picture, things like that these are things that are super easy that you know, there's samples, there's code snippets, and you can just go in and copy paste into your app and just support that these are really small additions you can do and then it will really shine on those new devices and step three, is where really all the magic can happen you know, you have more real estate now so there's many new design patterns, you can think about lease details, you can think about a companion plane and a few others so what now will you do in your app that, you know, you have more real estate, you can do things differently? this is step three, which is i think, you know, where all the big value will come but it's a journey towards getting there ade oshineye 20 43 definitely, i think one other thing you may want to include is, at the most basic level, you check things like if i rotate my phone, does your device crash? does the app crash? or does it handle it? and then use thing? okay, so you handle rotation, you don't lose state if i'm halfway through typing a message, and i accidentally rotate my tablet, do you lose my message? that's bad yeah so that continuity is an important thing, all the way up to things like handling hinge occlusion so if you've got a surface duo, there's a hinge down the middle, you've got to remember that there we have an api for that, handling different postures of the device, and even trying to see if you can use those postures to offer new functionality but for a lot of developers, it's stepping back thinking about all the different contexts in which people are going to try to use your app and then making sure that you've handled them tony morelan 21 31 yeah, and guy you had mentioned about them testing, i wanted to also bring up that samsung has their remote tests lab, where you can online access a real device for testing your app so another great resource for developers to, to work with guy merin 21 49 definitely, it's also that in the emulator, the emulator is also an amazing resource, because you can run it locally, you can run it on the cloud, we have some workflows that connect to a cloud emulator so every time you know we have a few samples, so every time we do a check in for the sample, it spins off an emulator and test it looks great so we have all these test steps and none of that is specific to us to the to the demo, you can run it with any other devices well, tony morelan 22 15 tell me what is the figma design kit guy merin 22 18 figma design kit is a tool for designers to start thinking about foldables and large screens and dual screens so when we started the journey with developers, we first were thinking about the developers, how do we support you with sdks and with samples and with documentation, that's step two, actually, step one is thinking about your designs and then we started looking at what are the tools that designers use so figma is one of them and there are others so we just created figma design kit for foldables so it lists out all the layouts that are possible again, the list detail, the companion pane and a few others, gives you all the frames and really helps you think about the scenarios you want to cover in your in your app for these new form factors and then you start working with the developers and the sdk, there's actually a step three that we're trying to do in the future, which is, how do we make it easy? taking a figma design kit or another slope and making that into code? that's going to be the next step in the future? tony morelan 23 30 are they tell me about the jetpack window manager and the jet news demo app? ade oshineye 23 36 so like many people, we have quite some quite old demos that were written in a world where you had a phone and you had a tablet and so we like everybody else had to think about, okay, how do we change this to handle different postures, different aspect ratios so we have an article where we walked through the process we went through to use jetpack window manager to handle a lot of these configuration changes to handle continuity, rotation, a lot of those things so we got actually pretty good article about this i think one of the things we don't touch on in that article that i think is really important, is if i have an existing app that people like, and it's too expensive for me to do a complete rewrite, how do i start adding some of the new things into it so we have a new thing called activity embedding, which lets you get a foot in the door of compose, or we're starting to add these new, more complex layouts so maybe your app was just, oh, i have a bunch of cards that go vertically up and down the screen but it's actually no longer a phone it's a device that folds out is not twice the size so now i need to think, okay, i need to go to a list detail view gmail is a good example of this you do that unfold or you rotate and now you have so much more screen estate the challenge is, how do i embed the new more complex layout index? system set of layouts i already have without having to do a rewrite so there's a lot of that functionality that we're trying to show people because we don't want to fall in the trap of the only way you can get to the new world is to burn everything down and start again we want to give people an incremental path from where they are to where they need to get tony morelan 25 18 i was at gdc, this past year in samsung had a great presentation this morning did you get a chance to see that that presentation at gdc? where they talked about developing for foldables? søren lambæk 25 30 yeah, yeah yeah, yeah, it was one of our team members, mike there was doing a presentation tony morelan 25 37 yeah, i'll make sure to include a link to that to that presentation it was great because they covered foldable optimizations for game engines like unity and unreal, talked about android jetpack apis, and window manager showed examples of things like flex mode and ui scaling, and even had an engineer from unity talk about adaptive performance 4 0 ade tell me what should a developer consider when writing a new app for foldables? ade oshineye 25 46 my immediate reaction to this is, first of all, should i use views? or should i use compose, but i'm talking to more and more of my colleagues, they all go? well, obviously, they should compose because composers the future so the official google recommendation, if you're starting from scratch, start with compose, it will mature as your app matures the other things to think about is what makes foldable special, it's the fact they have all these postures, they have all of these different kinds of usage scenarios that they offer and then you want to avoid littering your code with designs that are attached to a specific screen size, or a specific aspect ratio, or a specific resolution and instead, you've got to decide am i adaptive or responsive? will i try to scale the same design? or will i move the components around when the posture or the orientation or the size changes? it's a difference between an app with a list of cards and the cards just get bigger? and an app that says, well, when you rotate me, i go to a list detail view? tony morelan 26 52 guy, what are your thoughts on what a developer should consider when they're writing a new app for foldables guy merin 26 59 so i think a developer should consider a couple of things one, there's folding features specifically for duo, we have, we have a hinge in the middle so if you have like controls, do you want to put them in the middle, or maybe you want to lay them out a little? a little differently for game developers, we did a lot of work for example, with xbox so when you play a game, you can have the controls on one screen and the game on the other screen so the controls, you know, are now have their own dedicated space so maybe you can do some stuff with it so for example, the one thing we did is depending on where you are in the game itself, the controller themes and the way they look change so if you're now a pirate on a ship, and you're in a sword fight or something, the controller is changed to be a sword, for example, or things like that and then other considerations are the posters so what happens when the device is folded? what happens when it's open? what happens when you rotate it? and all these will change the layout of the app and show different controls and options for the use of yeah, tony morelan 28 12 yeah soren, what would you say are some of the common issues that could come up when designing around foldables? søren lambæk 28 22 i think it's important for developers to consider the ui because on the samsung fold, when the phone is folded, we got like a single display so the aspect ratio on that one is very different to when you're when you got it unfolded so the ui, you will have much less space for ui so that is something that's very important that the transition from going from single display to what's the display, that the ui will change so it fits, there's no point on like, you can see all the ui on when it's when it's unfolded and then when you go to the single screen, half of the ui is not a clickable or you can see it so that's very, very important that you test that on your on your phone tony morelan 29 11 yeah, and i know it's a gdc presentation that's one of the things that mike covered was how to have your game go from the single screen and then when you open up the device, how it transitions to the to the door screen søren lambæk 29 25 yeah, exactly ade oshineye 29 26 oh, actually, that reminds me one thing i, i keep mentioning continuity and mostly people think, oh, i have my device, let's say to tablet like this ultra i have in my hand and in in the vertical orientation that's easy and if i rotate, i don't want to lose my state that's typically what we've always meant by continuity but once you have a device that falls, especially if you've got something that has three screens and how to screen them into screens, i may launch something on the outer screen then i open it up and then the app has to move on or the activity as we found that out the screen to now maybe spread out across both screens and then if i fold it the other way, so i'm now on one of the inner screens, the app has to not lose state now we have a bunch of guidance on how you define normal apps, where it gets especially tricky is when it's things like camera, where you may not just be moving an activity across screens, but it may actually move it across cameras okay, so this is one of those places where, if you have a real device in your hand, you can see it and you can see how for a user, this would be a very comfortable, obvious thing, they would expect holding the device in their hands but for you sitting behind your keyboard, it might not leap out as you as an obvious thing for a user to do yeah, so if you sit with erica, with us a samsung flip, you can take a selfie on it, but you might just very easily rotating your hand and because you want to take a selfie with the other camera for your app that's a very complicated thing for the user it's the most natural thing in the world sure so it's important to think about continuity across the different surfaces of the foldable yeah, guy merin 31 07 yeah and let me give, let me give another example with an email app can be gmail, it can be outlook, it can be whatever it whatever you're using and i think foldable or dual screen is really a great way to read emails so if, if until now, i was used to, you know, in the morning to get to my emails on a single screen device so i just have a list of emails, and then i go into each one of them, read it, go back, go to each one of them, read it, go back reply, what have you, if you don't have a larger screen, you can have the least detail so i see all the emails in one place, i click them and then the other side, i see the actual email that i need to address and now if i have to, is a lengthy email, if i have to read it, i can rotate the device and then i get into this a form, that i across the whole screen, i just see the whole email as detail and then when i hit the reply button, it can go into this laptop mode that you know, the keyboard goes from the bottom and then i could start replying to it and when i'm done, i get back to the least detail up to my next email so it really can serve as a laptop replacement yeah, because you have a larger screen, you can do pretty much in a productive manner, which you can do with your regular pc or mac tony morelan 32 27 yeah, for sure so guy, do you think it's a misconception that developers need to do a lot of custom work, that's only going to be that's only going to add value to a foldable device guy merin 32 38 i think it's a misconception, definitely, there's actually not a lot of work you need to do as i said before, you could start small with just adding drag and drop functionality or picture in picture and that will work across every place, every form factor around large screen small screen, and you're using native api's and sdk to support a foldable, you don't need to pick up another sdk for it it's all supported natively and whatever you do will work across all these devices and again, in the future, it can work on the tv or other on a watch so whatever your app will do, consider all these layouts provide layout screens, for each one of those new form factors, a single app will work on all of it ade oshineye 33 28 yeah, i think something i did this weekend is i went and dug up all my old android devices, i have android devices, going back to the g one and even the ones before the g one that i'm not sure i'm allowed to talk about in public, all the way to the latest ones from today and as developer, handling all of these different scenarios, is actually increasing the maintainability of your app because if i think about the screen on the g one and the resolution of that, and i think about that, compared to the resolution, the pixel six, it's a huge jump, and the screens are so much bigger so think about the kinds of devices we'll have five years from now, how much bigger how much higher resolution will those screens be? how often do you want to rewrite your app between now and then? versus oh, it's just a bigger screen at all it's a different posture and being able to make it a relatively simple migration or maintenance that versus a yet another rewrite tony morelan 34 31 so tell me, soren, what are some good examples of existing apps that are taking advantage of the foldable form factor? søren lambæk 34 39 so we have seen a lot of retro games actually, you are utilizing the phone a lot so because retro games don't really have that much heavy graphics so they've got like, plenty of space that they can use so we have seen where people are using a virtual gamepad on one screen and using live small mini maps and that kind of thing so that's okay seems but i also think that like when you're watching it like a video and you start like folding it, and you just see the video slide up on just one screen, because it assumes that you want to put it on tape or something i think that is really clever and i would like to see more of that thinking tony morelan 35 19 in a day, what are some great examples of existing apps that are taking advantage of the foldable form factor? ade oshineye 35 24 so we see a lot, but actually, my two favorites were shown to me by guy, one was a battleships game where you basically have the device in a tabletop posture, and you basically rotate it the other way for the other person to play oh, i thought that was beautiful yes love that and the second thing he showed me was just the kindle yes so basically be able to have the kindle open like a book, but also be able to fold it the other way so like a like a cheap paperback, where you fold it and you hold him in one hand exactly i would never do that for any of my books, but been able to do that and like surface to that field like that is so nicely that i think was really compelling tony morelan 36 02 and that was the first thing when i when i pulled out the surface duo showed my wife, the first thing she did was grab it in, folded it around like it was a traditional paperback book that was so easy to hold she absolutely loved that that aspect of it guy tell me, what are some other examples of some great apps that are already taking advantage of a foldable, guy merin 36 25 i think two kinds of app one is apps for consuming and i think the kindle is a good example of flipping a page, which is supernatural i really liked that experience as well, but also apps around creation so for example, if you need to edit a video, or edit your photos, or edit the blog post, it's very easy with dual screen or with the foldable or our screen to have the actual video or photo on one side, and on the other side, all the controls, and then you hit a control and you see it real time, what happens, how does it change the other, it's really, really helpful to create and edit your memories that way so it's really a great creation tool, as well, not just for consuming tony morelan 37 12 yeah, i could definitely see that also be a great value with a program like adobe acrobat you know, i'm often editing pdfs and so i could see that would be a great use case for, you know, not only being able to read documents, but then you know, making edits ade oshineye 37 28 i can also imagine with that sort of notebook, passport, sort of novel types, device, where if it's light enough and thin enough, you can sort of fold it in half with a stylus, and just scribble it like you would have a normal notebook, basically, like a moleskin but it's a moleskin with an infinite number of pages there's, guy merin 37 49 there's also psychological sense here, about the folding, and that you can close it so for example, if i'm writing or scribbling or journaling with a stylus on the device, when it's open, when i'm done, consider if you're doing it on a regular notebook, what are you doing, you're closing it, and it gives you a sense that you're done you accomplished something and i think this is where foldables really shine because you're doing something you're reading an email, you're journaling, you're even playing a game, once you're done, you close it, even you hear that little click yes and it gives you a sense, you know, it's like checking a box in your to do and i think this is something that you don't see in other form factors and you see it only on this folding devices that really helps users stay in their flow and then move away to, you know, do something else that is not related to the phone so leave it off and you know, digital wellbeing and stuff tony morelan 38 46 yeah, it's funny that you say that, because that was the one of the first things i noticed when i closed my duo hearing that little click sound it's sitting on my desk i was like, ah, okay, put that away ade oshineye 38 56 yeah, yeah, that's actually not the interesting effectiveness is that with the foldables, initially, because of weight, and then eventually, because of new user journeys, they switch from being in your trouser pocket, at least for me to being in a jacket pocket and that's something changes all the places i use them tony morelan 39 14 interesting yeah and i know when i first got my hands on the z flip, folding it to that such small form factor and putting it in my pocket just felt so much better than some of the bulky devices that i seem to carry around with me søren lambæk 39 30 i actually heard that people who using the ac flip, use the phone less because they have to open it manually so for them, it actually helps them a lot to not like spend too much time on the phone so there, i guess there's some psychological effect ade oshineye 39 47 i mean, i've had the opposite with my flip in that because it's so small, and because it sorts of made me take more selfies i don't usually take selfies because well, i usually have a real camera with me, but i have this thing, it's small enough that it's in the back pocket of my jeans and it's just arms were nice and i would normally just take a photo of the place but as thing i can pull it out, then basically without having to unfold it, or unlock it just pointed on my face, click selfie, put it in my pocket again so for that one particular user journey, i use it more tony morelan 40 20 interesting yeah, i could, i could totally see that but tell me a day, what are some of the challenges that foldable technology needs to overcome to increase consumer adoption? ade oshineye 40 31 i mean, if i look at the variety of devices, i have the flip back pocket of jeans every time when it comes to the fold, i have to sort of look at the jacket i'm wearing and think about, okay, will the material the lining handles the weight, or should it go into my bag, if i'm carrying this surface duo, it's light enough that i can just casually put it in my jacket pocket, it'll be fine but it's too bulky for me to put in the front pocket of any of my jeans and it feels dangerous to put in the back pocket so weight is an issue cost is also an issue because the more expensive it is, the more careful you have to be when you put it away to think, will it be safe in this pocket but as these things get thinner, lighter, cheaper, and we discover more and more user journeys, i think that's going to be really interesting if i give an example, i have the surface level one, and it's great but every now and again, i see somebody surface two or two and i go, oh, they have a pen oh, that's interesting and i find myself thinking, well, that might be an interesting upgrade if it were thin enough and light enough, but then i'm thinking, but will it fit in my jacket? pocket? tony morelan 41 37 sure that's interesting guy tell me what do you think are some of the challenges that the foldable technology needs to overcome? i guy merin 41 45 think the first obvious one is the price point, they're still more expensive than other form factors so i think we're going to see the prices, the prices go down? for sure i think that would be probably my biggest one i think we did not hit the point of, you know, apps, enough apps are there, we'll see more and more apps, and then everybody will want to join the party i don't think we are in that stage yet and i think that will come soon tony morelan 42 13 and so on, what are your thoughts on what sort of challenges that the foldable technology needs to overcome? søren lambæk 42 19 the foldable phone at the moment is very bulky, and it's very heavy, it will be great that it was if it's lighter, i'd know that people that it actually puts people off some people that it is so bulky and heavy, where they will rather i get the flip phone for that reason i also think speaking of the flip, i think battery life is an it's very important i don't know how much bigger battery they can put in them without even giving more bulky and heavier but when you have like on the samsung one, there are three displays and if you use it for game watching films, it's really draining battery so that is i will say that is the big ones for me tony morelan 43 03 so guy, what resources would you recommend for developers interested in creating foldable apps, guy merin 43 09 i think you know; our modal is really meeting the developers where they're at so continue using whatever you're using if you're using a mac or pc, we have emulators for each one of those things so i would start with just following the recommendations you know, we have documentation samsung has google, start there, download an emulator, try it out and then just write a sample app, there was a code lab that we built with google, you could try there to test some of these new capabilities on the emulator on a specific device and then start your journey from there to commutations samples emulator we post a weekly blog, a weekly developer blog every thursday, that brings new information, for example, how to write again, how to use drag and drop, how to run side by side with another app, how to address the post changes, well, layout changes so we have a blog every week that covers code it's a developer blog with specific code and tips and tricks, try those resources and just reach out if you have a question and if you're blocked on anything, we are really here to help you out with your journey because we're creating the future and we want you to be successful with your app on all these new form factors tony morelan 44 34 yeah are there any conferences or events the that you know that you'll be attending? guy merin 44 40 definitely so google io was just completed a few weeks back, a lot of talks around large screens, you can still follow that and see some of the talks droidcon is coming up we just had droidcon san francisco a couple of days ago, and the next one is in berlin, and it's a worldwide conference google's probably going to have a few to prevent samsung has a few events microsoft build was just a couple of weeks ago and we also had to talk about tony morelan 45 08 foldables excellent and i know a day you shared with me a large list of links tells me, you know, what are some of these resources the developers can utilize ade oshineye 45 19 so for us, it's really three buckets there are introductory materials, such as our quality guidelines that i think are really important to sort of absorb into your bones so you can feel what a good experience will be like, and it will nudge you as you go on then we have a large collection of design resources, often at the material design website, but also woven through developers@android com and then the final piece is a set of resources for the developers things like how do i do testing the code library with microsoft but those three buckets of resources are the right ones for you to start with i'd also recommend come to door con berlin, were given a talk a teammate of mine, romano, france will be their co presenting with somebody from microsoft and again, you can go grill those people get lots of questions and of course, there will be future android events, where we'll have more stuff to share tony morelan 46 14 wonderful insight on what does samsung have to offer to help developers søren lambæk 46 20 so sometimes we got our own a game dev space where we posted blocks and tutorials, articles and we will have some when this podcast is out, we should have some tutorials available we also got the gdc presentation that mike did tony morelan 46 37 excellent so any more thoughts as we close the podcasts on this new technology in foldables ade oshineye 46 45 from my perspective, looking at my desk, i've got a flip duo, a samsung tab and that really captures just the variety of form factors that are happening on the android platform and i look forward to seeing more i think that's one of the things i learned here is that there's so much going on and there's so much more to come søren lambæk 47 06 i'm really looking forward to the future to see what new technology and what new devices coming out how the foldable phones will hopefully be more like lighter and more affordable and yeah, i'm really looking forward to see how developers is going to utilize them for all kinds of different apps guy merin 47 28 i think i think this is super exciting times, we are really in a pivotal point of, you know, something new, something a new generation of four factors evolving, and it's happening right now we started seeing the version one of the foldables and tools, we're now seeing a second version and a third version and i think we're going to see more of that and this is just amazing we are creating the future right now and i think developers are the most important part of it, because it will succeed based on the apps, and what developers will do with it and this is a great time now to join this ride and really create the future because i think 10 years from now, we will see things that really start happening right now with apps that take you to the next steps with foldables yeah, tony morelan 48 21 my key takeaway with the foldable industry is how many of these big companies in this industry are working together to further the technology it was great to have you know, someone from google from microsoft, and of course, from samsung, all on the podcast today before we close this out, i want to ask a question of each of you soren, what is it that you do for fun and when you're not at your desk working for samsung? søren lambæk 48 46 as i already said that i do like art to play music and draw and i have an eight-month-old son that's taking up a lot of my time at the moment tony morelan 49 00 wonderful wonderful yeah, congratulations on that thank you in a day, what is it the you do for fun when you can step away from your role at ade oshineye 49 09 google? so i do a lot of things but i think the main thing that occupies my time nowadays has been playing badminton it's an it's a huge part of the swiss culture and there's just a lot of people who play badminton, so it's a great game you can actually get seriously injured in it but you can also get very good at it so i'd recommend it tony morelan 49 32 in guy what is it that you do for fun up in the great northwest? when you get to put aside your responsibilities at microsoft i can see in your background now i noticed on your wall, you've got your own indoor rock-climbing gym guy merin 49 45 yeah, exactly so trivia in the last six months i've been training really, really hard to climb and summit some of the mountains around north washington goal is to get even bigger mountains but we did a couple of summits last weekend and really into climbing and something mountains now wow takes a lot of mental prep, nutrition, fitness level and i've seen a lot of similarities between the experiences i have with preparing for a climb, to even things i do at work it's really managing a project, a lot of insights i got from climbing that i apply in other places tony morelan 50 25 that's great that's great hey, i wanted to thank all of you for being on the podcast today it was wonderful to hear the different voices and get a chance to chat with you all ade oshineye 50 34 thank you very much for having us you closing 50 35 just looking to start creating for samsung download the latest tools to code your next app, or get software for designing apps without coding at all sell your apps to the world on the samsung galaxy store check out developer samsung com today and start your journey with samsung the samsung developers podcast is hosted by tony morelan and produced by jeanne hsu
Connect Samsung Developer Conference
webtech sessions dive into the future of connected customer experiences through tech sessions by developers offering further insight into the innovations introduced in the keynote filter filter filter all reset apply there are no results. sessions contents & service, open innovation 8k visual quality and ecosystem in this session, we will present how the genuine 8k contents correctly displayed on 8k display devices could deliver our customers an immersive picture quality experience. we will start with a summary of the previous studies about user perceptions regarding the 8k visual quality. we then will explain why the full-frequency 8k contents are superior to the lower resolution in producing fine details on the image. we will also discuss some technical challenges we face toward adopting and utilizing 8k contents in a real-world environment and describe how we can overcome these hurdles. specifically, we will discuss technologies such as super-resolution and new image sensors to overcome the full-frequency barrier of 8k content. last, we will introduce the 8k association (8ka), a non-profit organization composed of key technology companies in the consumer and professional 8k ecosystem, and briefly mention 8ka's ongoing effects on the research, standardization, and promotion of 8k visual quality. sessions contents & service, developer program, mobile add samsung pay as your payment method in this session, we will share learnings from our experience developing the samsung pay mobile payment service, revealing insights that can be applied to your own platforms. we will also take a look at the samsung pay development kit and how you can use this for your own service. sessions game, ar, mobile ar emoji: your avatar, your experience the ar emoji feature on samsung devices enables users to create a 3d avatar model that can be used in other applications. similar to avatars currently available in games or in the metaverse, our ar emojis are a chance for users to express themselves, their style and their personality, digitally. but this is only the beginning. in this session, we’ll explore the future of ar emojis and how the ar emoji sdk is opening more opportunities for developers to collaborate with samsung to bring to life new services featuring these avatars and optimize them for the metaverse though our collaboration with unity. sessions ai, iot, smart appliances bixby 2022 what’s new what’s new with bixby in 2022? in this session, you will hear about some of the exciting improvements to the nlu and on-device bixby as well as updates to the bixby developer studio, which introduces a brand new javascript runtime that provides a modern, secure, high-performance environment. we will also take a closer look at the brand new bixby home studio, which allows smart device developers to customize and optimize voice control of smart devices, including allowing a single command to intelligently control multiple smart home devices. sessions contents & service, game creating spectacular galaxy game audio experiences with dolby atmos galaxy smartphones and tablets can produce spectacular game audio with dolby atmos. discover how you can create deeper emotional connections with players, keep them playing for longer, and earn their loyalty by unleashing the full power of samsung galaxy mobile game audio. in this session you will hear from dolby’s partner audiokinetic who will discuss how developers can make dolby atmos games, including a walkthrough of how to use dolby atmos plug-ins in audiokinetic's wwise audio middleware. moong labs – creators of epic cricket one, of india's most popular sports games – will also share how dolby atmos benefitted their game and you will find out how dolby supports game developers and other activities on our website. sessions health, wearable expand health experiences with galaxy watch the galaxy watch’s powerful bioactive sensor, together with the wear os powered by samsung, is transforming mobile health experiences. and now, this technology is even more powerful thanks to the samsung privileged health sdk. find out how the samsung privileged health sdk is allowing developers to retrieve raw or analyzed sensor data for their applications, including bia, ecg, blood oxygen level or sweat loss, and help users’ to accurately monitor their health stats. sessions web flexible and private web experience on samsung internet in this session, you will learn how to enhance and optimize your web experience for foldable devices using device posture api and viewport segment media query. we'll also take a closer look at how samsung internet protects users’ privacy online. sessions mobile, enterprise, developer program google and samsung strengthen enterprise ecosystem together samsung’s global mobile b2b team is working closely with the android enterprise team to build a galaxy ecosystem of partners who are bringing innovation into workplaces. discover how partner solutions create unique experiences on samsung devices and how we plan to work together to help future partners step into the samsung android ecosystem for enterprises and smbs. sessions contents & service, developer program, enterprise hdr10+/salt and automatic hdr video creations for productions hdr10+ is an essential technology for premium hdr viewing experience and it is widely reach to consumer displays including mobile devices. in order to provide hdr content services, it requires changing service provider's infra structure or workflows and video processing technology from sdr to hdr with a lot of engineering efforts. then, hdr10+/salt solutions and partnership program from samsung is designed to build an extremely cost effective automatic solution up for content creators, post production houses and ott service providers even including game developers. the solution package is designed with various standalone applications, reference apps, sdks on various oses and partnership programs to help 3rd parties for creation of hdr contents. hdr10+/salt partnership program provides full compatibility to hdr10+ llc certification program and major studios, ott service providers and tool makers are already partners of the program and samsung provides them the best hdr content quality. sessions developer program, open innovation, health healthcare research hub our open source project provides end-to-end solutions such as sdk, platform, and portal for various use cases from medical research studies to clinician services using wearable devices. medical research does not have to stay complicated. anyone can easily build and customize their own research studies or clinician services using this open source. recently, as the accuracy of sensors installed on wearable devices has improved, interest in healthcare research using wearable health data is increasing. however, it takes a lot of time for researchers to develop research applications and server infrastructure for storing and analyzing data from scratch. sr is developing android sdk and data platform solutions that support healthcare research using health data from our wearable devices (watch 4 and later versions) and provide them as open source in order to solve the pain points of these researchers and establish a digital health care research ecosystem centered on our wearable devices. sessions iot, monetization, smart appliances home connectivity alliance introduction of home connectivity alliance and how appliance manufactures can enable interoperability across brands. hear how hca interoperability can benefit consumers and partners including b2b (home builders, mfu, etc). join the hca and become a leader in innovation within the connected iot ecosystem. sessions ai, ar immersive audio we will demonstrate an audio system with dramatically improved immersive 3d audio experience. hardware will be similar to samsung’s critically acclaimed hw-q990b soundbar, but will include several new technologies that will be found in future samsung products. these technologies automatically correct for room acoustics and the location of the listeners and loudspeakers. visitors will compare the sound of the system before and after the system’s unique automated calibration process. listeners will enjoy improved spatial and timbral performance in stereo, surround and immersive audio formats with both music and cinematic content. sessions security & privacy introducing blockchain wallet with knox vault in this session, we introduce blockchain wallet for samsung smart tv. blockchain wallet allows our smart tv users to manage their blockchain accounts and transfer their cryptocurrency to another blockchain account. it ensures to retain a key for blockchain transactions in a secure way. dapp developers can build their tv dapp with blockchain wallet for blockchain functions such as blockchain connection and transaction signing. knox vault is an enhanced hardware-based security solution to protect sensitive data such as cryptographic keys, passwords and personal data. knox vault provides strong security guarantees against hardware attacks such as physical attack, side-channel attack and fault attack. as a core component of the knox security platform, knox vault is an isolated, tamper-proof, secure subsystem with its own secure processor and memory. sessions developer program, enterprise, android introducing samsung galaxy camera ecosystem discover how advanced camera technologies, based on samsung’s leading hardware and software, can enable developers to create more powerful camera experiences for their users. we will take a look at some of the incredible partnerships samsung has already formed with numerous app developers and reveal how these collaborations enriched users’ camera experiences. sessions mobile, android, productivity intuitive multitasking experience based upon android 12l join us to see how samsung continues to enhance the large screen user experience further with fast app switching and intuitive multitasking capabilities. to maximize the galaxy foldable experience, we're expanding flex mode even further with more apps and partners as well as google's ongoing collaborative effort in android 12l. sessions iot, mobile, uwb joint efforts on standardization toward open ecosystem of uwb services the presentation will introduce samsung's joint efforts with industry partners on the uwb tech/service standardization, which is essential for creating an interoperable open ecosystem of uwb products and services. especially, it will introduce activities at fira consortium, which was established by samsung jointly with industry leaders to provide interoperability specifications as well as certification programs. it may also include target uwb services and relevant standardization status & plan. sessions ar, game, tizen journey to immersive interactive exp in big screen with xr and avatar fw xr framework webapis enable developers to build xr applications on the tizen platform. we will go over features of the webapis, share some demos, and provide information on how to get started. additionally we will show you a sample code of how to capture and handle user's gestures and full body movement. avatar framework for tizen is a unified solution providing high level apis that allow samsung developers to easily include the 3d avatar models and features in their samsung tv applications. we will go over all the cool features and options of our framework in this video. sessions connectivity, android, mobile le audio: the future of wireless sound introducing le audio: a new standard for bluetooth technology on galaxy devices. le audio will enhance the performance of classic bluetooth audio and introduce isochronous communication, creating whole new wireless audio experience on galaxy devices. in this session, we will introduce the technical features of le audio, what it means for the galaxy ux and how you could enhance wireless audio experience of your app with le audio. sessions design, ui/ux one ui design principles in partnership one ui creates a unified experience across our galaxy devices, from phones and tablets to watches and galaxy books. in creating and refining one ui, we've followed four key principles: simplicity, effortlessness, consistency, and authenticity. with one ui, we've also made a commitment to openness, which means some of the best things in one ui come from partnerships. in this session, we'll talk about some of those partnerships and how we aligned them with our four design principles to get great results. sessions ui/ux, design, android one ui: customer centric design one ui starts with a true understanding what our customers want. hear more about what samsung have learned from listening to extensive customer feedback and usage data, and how we have adapted our designs in response. we'll take a look at some real-life examples of how the ux design of the calendar, settings and samsung health app has evolved over time to better meet customer needs. sessions enterprise, data, security & privacy our journey to responsibly handling data at samsung, we place personal data protection as one of our top priorities. learn how we responsibly handle personal data in our applications and platforms. we'll share with you our journey in protecting personal data. we'll talk about what it means to responsibly govern and access data in samsung's enterprise environment. we'll cover specifics on how to classify & protect data as a whole. pick up insights on privacy technologies and design patterns we apply in our data intensive applications today. sessions developer program, tizen, ui/ux prism: the new ux development tool and process in today’s environment of rapid and unpredictable transformation, establishing a creative and increasingly collaborative tech culture is one of the most challenging requirements. in this session, we would like to introduce a new method to revolutionize the tizen platform-based app development process. a new development process named prism automates most of the inefficient overheads from design to implementation of app ui, innovatively improving app development productivity. we will introduce prism-based development process and deliver this innovative app development culture to developers through the sessions. sessions developer program, smart appliances, tizen remote test lab: what’s new in tv development environment the current tizen tv development environment, represented by emulator and tv, is a very limited support method for developers. depending on the version of emulator, the latest features currently supported by the tv may not be available, and various models of physical tvs may be required to verify actual operation. rtl tv tries to overcome the limitations of the current development environment. sessions contents & service, monetization, data samsung tv plus: the advanced ad-tech and partnerships that fund free tv samsung’s free ad-supported tv (fast) service “tv plus” has been a breakout success. although it looks and feels like traditional tv, it is anything but! behind the scenes of this slick tv & mobile experience is high-performance technology, vast amounts of data & algorithms, and a thriving partner ecosystem. join this session to learn more about the mind-boggling world of advertising technology, how it works, and how multiple companies come together to provide free tv to millions of consumers worldwide. sessions android, contents & service samsung wallet, it's convenient, personal and safe as the growth of digital wallets skyrockets, samsung recently announced samsung wallet – a new platform bringing almost all of the cards you’d typically find in a physical wallet, as well as important documents, into one easy-to-use and secure mobile application. as samsung wallet rapidly expands its content set, find out more about the future of digital wallets and how open api’s can allow developers to build integrations for this service. sessions iot, security & privacy smartthings edge: the next level experience discover how samsung is transitioning the smartthings-published groovy dths to edge drivers while maintaining a seamless experience for our users. we’ll walk through the process of onboarding edge-based devices and how to set up an automation with an edge device that runs locally. sessions iot, monetization, smart appliances smartthings energy service introduction of smartthings energy service and how partners (energy companies, smart device mfgs, etc) can integrate to provide a seamless energy management service for their consumers leveraging samsung's smartthings energy ecosystem. sessions iot, contents & service, open innovation smartthings find: find alongside 200+ million users smartthings find is samsung’s fastest growing service, powered by more than 200 million galaxy users. discover some of the new features and functions added over the past year and learn how partners can leverage the service to innovate their own solutions to meet the needs of businesses and consumers alike. sessions iot, contents & service, open innovation smartthings platform enhancements for openness and interoperability the smartthings platform continues to evolve to promote openness and interoperability. in this session, we will share some exciting new updates to the smartthings platform to support matter and thread, and discuss the home connectivity alliance. sessions health, tizen telehealth in samsung devices samsung display device (smart tvs & smart monitors) users will be able to launch telemedicine service within the samsung products. once you pick your physician, you can use one of the approved usb cameras to connect to the tv and jump on a video call with a physician via external service provider's built-in web applications. after a few account setup process on mobile / pc, you can easily start your session any time on tv without any additional complicated inputs. at your session, you can also receive a prescription to be filled in at a mail-in online pharmacy (pc or mobile) to receive prescription drugs at your doorstep. sessions open innovation, enterprise, productivity the next generation samsung retail solutions in a mobile-first world, device convergence, simplification, ergonomically designed accessories, sw solutions and the connected galaxy ecosystem are helping to boost productivity and efficiency in the retail industry. in this session, we will explore how the next generation of retail solutions are shaping the industry’s future and will take a closer look at samsung’s three major retail solutions - data capturing, payment, and push-to-talk. sessions developer program, mobile, android the samsung knox partner program: partner success journey the samsung knox partner program (kpp) equips you with everything you need to build ideas and market your mobile solutions. in this session, we will take a look at some of our partners’ solutions and how collaborating with the samsung kpp has helped enhance their user experience. join us to see why kpp is causing a stir in the business developer community! sessions enterprise, tizen tizen everywhere this session highlighted samsung's direction and goals for the enterprise and b2b markets, focused on taking tizen to the next level on so many platforms. various enterpriser displays based on tizen and solutions suitable for business purposes will always be together. tizen enterprise platform will provide all the technology infrastructure you need, including the samsung developers portal for b2b for developer support and the samsung apps tv seller office for custom application support in your own business. after announcing "tizen open" at sdc in 2019, samsung established licensing system to provide tizen tv os to other tv makers. in order for partners to develop tizen tv products faster, samsung prepared reference tv solution. in europe, australia, türkiye, tizen tvs have been released sequentially through more than 10 tv brands since september 22. sessions wearable, design, android watch face studio's first journey and expectation for next a must-have to create beautiful watch faces! watch face studio (wfs) is now a little over a year old. hear the developers of wsh share the highs and lows of bringing the tool to life and meet the designers responsible for creating the eco watch face. this session is an insight into the year-long journey to create wfs – and the story of where we’re going next. sessions iot, tizen, ui/ux what's new in tizen? are you curious about the direction in which intelligent iot platform “tizen” is developing? this session introduces ui assistant technology and extended 3d ui framework for providing advanced user experience, and explains innovative technologies that make run the tizen platform on top of the android hardware abstraction layer to facilitate securing new hws. and introduce the iot standard 'matter', which will be newly supported on tizen. finally, we provide a guide and tip for cross platform application development. sessions ai, iot, smart appliances what’s new in bixby for smart home bixby brings the smart home experience to life with the power of voice. find out how our new tool, bixby home studio, will enable device manufacturers to build more intelligent, more engaging voice experiences for smartthings-connected devices. sessions mobile, design, ui/ux what’s new in one ui 5 one ui 5 pushes personalization and productivity to the next level. explore new features that enable you to build a galaxy experience that reflects your personal style and help you to get more done on all your devices, wherever or whenever you need to.
Learn Developers Podcast
docseason 2, episode 6 previous episode | episode index | next episode this is a transcript of one episode of the samsung developers podcast, hosted by and produced by tony morelan a listing of all podcast transcripts can be found here host tony morelan senior developer evangelist, samsung developers instagram - twitter - linkedin guests samsung internet advocacy team samsung internet dan appelquist, director of developer advocacy, samsung laura morinigo, developer advocate, samsung lola odelola, developer advocate, samsung ada rose cannon, developer advocate, samsung kevin picchi, developer advocate, samsung listen download this episode topics covered the benefits of samsung internet browser web standards and user experiences foldables and responsive design privacy and security ar/vr augmented reality / virtual reality android developers immersive web weekly 5g tours w3c helpful links samsung internet website samsung internet blog samsung internet meetup twitter – samsung internet developer advocacy transcript note transcripts are provided by an automated service and reviewed by the samsung developers web team inaccuracies from the transcription process do occur, so please refer to the audio if you are in doubt about the transcript tony morelan 00 01 hey, i'm tony morelan and this is pow, the samsung developers podcast where we chat with innovators using samsung technologies, award winning app developers and designers, as well as insiders working on the latest samsung tools welcome to season two, episode six on today's show, i'm joined again by dan appelquist from samsung internet but along with dan this time will be several of the developer advocates that work with dan that help developers build for the samsung internet browser during our chat, we'll talk with experts on building responsive web experiences for foldable devices, privacy and security on the web, and exciting new technologies related to web xr in the samsung internet browser enjoy hey, dan, welcome back to the podcast dan appelquist 00 48 great to be back thanks for having me back tony morelan 00 51 yeah, so i've already asked who is dan appelquist on the earlier episode but for those that don't know, you are the director of developer advocacy for samsung internet and i would highly recommend that you go back and listen to our episode from season one dan appelquist 01 05 it was great i loved doing that tony morelan 01 08 yeah so last season, we had you on the podcast, we talked about the samsung internet browser web standards, the importance of privacy and security in things like progressive web apps, dan appelquist 01 18 right and you'll probably hear some of the same things that you heard last year but hopefully, i'm going to give you something new as well tony morelan 01 27 in this new episode, though, i understand that you actually have some of your few of your experts from your team that are going to join us and give us a deeper understanding of samsung internet, as well as some new and exciting topics correct dan appelquist 01 37 that's right, developer advocacy for us as a team effort so i'm really excited to have the team here talking about the different areas of expertise that they're that they're working in, and the different technologies that they're playing a part in tony morelan 01 50 for new listeners let me ask again, what is samsung internet dan appelquist 01 55 so samsung internet is a browser, it's a web browser, it's a browser, that samsung ship on all android devices so if you have any kind of android device from samsung, your default browser is going to be samsung internet we're the purple planet that you might see on any samsung android device we are also available on other devices besides samsung devices so you can actually download us from the play store, you can download us from the galaxy store as well so that's pretty exciting because it means for developers especially it means that you actually don't have to have a samsung device in order, you know, we certainly encourage you to have a samsung device but if you don't have a samsung device, you can still load and test your website in samsung internet, which is definitely something that we suggest you do tony morelan 02 49 so what does samsung have a browser in the first place? dan appelquist 02 52 well, i think it comes back to the question of why do we have multiple browsers the web is enriched and is in continues to evolve because we have a dynamic in the web where users can choose people can choose which browser they want to use the web with and they can make that choice based on what they perceive to be the browser that gives them the best user experience the best features, you can access the same websites with all the browsers, that's the idea we'd never want to see a web where you go to a website, and it says, can only be accessed in google chrome or can only be accessed in microsoft edge or can only be accepted samsung internet, that would not be a good web to live in so when it comes to interoperability, the web is extremely interoperability for the web is extremely important however, it's at the level of all the features on top of the web browser that helps you to experience the web, where web browsers differentiate and compete and that's that is a really important dynamic because it helps the web to grow we've seen in the past how when one browser dominates the entire web innovation on the web stagnates and we never want to see those days return again, that was early 2000s when i he was like the single i think that 90% market share or something like that so strategically, we're pretty certain that having multiple browsers out there and having this dynamic and this conversation about what the best features are, is really important for the web, and it's really important for people who are using the web at the end of the day tony morelan 04 39 yeah, yeah, definitely i think that sort of competition is what helps, you know, drive these companies to come up with new and innovative ways to improve the technology absolutely so um, so let's talk about the chromium project so i understand that samsung internet is based on chromium chromium is the google led open source browser project to build a safer, faster more stable way for internet users to experience the web, correct? dan appelquist 05 04 that's correct yeah so i mean, google chrome is based on chromium there are lots of other browsers that are also based on chromium so microsoft edge is based on chromium samsung internet is based on chromium there are a lot of other browsers that are based on chromium brave is a great browser for desktop that is based on chromium that has a real strong focus on privacy and vivaldi is another one that is, again, they have a focus on serving developers on desktop so there's a real good ecosystem of chromium-based browsers out there and we're very happy to be one of the most used, if not the most, i think we are the most used chromium browser out there besides chrome well, so as for what our role is, in the chromium project, we definitely take the basic chromium build and we, we put samsung internet on top of that, however, we are also contributing back into the chromium project so we're, we're a strong contributor into the open source chromium project and we also take the chromium project, and we build samsung internet on top of it, which means building a lot of our own user interface on a lot of our own features and some of those features are the things that we're going to talk about today so what's tony morelan 06 26 the role of the developer advocacy team? dan appelquist 06 29 so we have a small team, we are based in london, what we do is, we talk to developers, we blog, we write code, we are at heart developers, who are technologists, who know how to speak developer because we are developers and we all have experience building production websites, production code and we also are, so we're out there, we're communicating but we're also listening and part of our role is to listen to the developer community channel the feedback from the developer community back into our engineering group we're very adamant that developer advocacy is an engineering effort we work most closely with our engineering team, both in seoul and in the us and we also play a role when it comes to internet standards or web standards so a number of us are playing leadership roles in different w three c working groups, w three c is the web standards organization, the world wide web consortium, which was founded by tim berners lee, i co-chair something called the technical architecture group there, which is like a review board for new web technologies ada, who you're going to hear from is the co-chair of the immersive web working group, which is working on web xr all the team members are playing some kind of role when it comes to web standards, which is important for us as well so having said all that, i'd like to first of all, introduce laura to the podcast, who's going to tell you more about what we're doing with foldables and with responsive design tony morelan 08 14 hey, laura, welcome to the podcast laura morinigo 08 16 thanks, tony how are you? tony morelan 08 18 very good very good so let me first ask what is your role at samsung? yeah, so laura morinigo 08 24 it's going to be two years that i'm part of the developer relations team so i'm a web developer advocate for samsung internet wonderful and tony morelan 08 33 you are based in london is that correct? laura morinigo 08 36 exactly in london, uk tony morelan 08 38 now, i will say that you don't sound like you have a british accent so where are you originally from? laura morinigo 08 43 really? i don't i'm originally from argentina yes, tony morelan 08 49 yes and i do know that you actually are working with my counterpart, diego lizarazo who speaks spanish as well you two are doing some webinars together is that correct? laura morinigo 09 00 yeah, exactly we're doing samsung and española that means samsung in spanish, where we do workshops, and things like that and actually, we're going to have something in june so stay tuned, guys nice tony morelan 09 13 looking forward to that so we're here to talk about foldable devices and samsung internet first, can you tell me what exactly is a foldable device? laura morinigo 09 21 well, yeah, full levels are devices in which the screen falls and you have an inch, and there are mainly two different physical form of factors so you have devices with a single flexible screen those are called seamless and devices with two screens, which seem and samsung lund two main devices which are seamless, the galaxy see sleep and then sec four, two what does this mean for developers? yes, so everything that is new for users is new for developers to because for develop first means new ways to create content with foldables, you have the chance to do multitasking, open more than one up at the same time and take advantage of the biggest screen it's like you have in the tablet inside your pocket so developers now you can create new ways to reach out to users, including from multimedia to different types of websites tony morelan 10 29 sure, sure now, i know that, obviously, when, when you've got your phone and you're holding it vertical, and then you rotate it sideways, you know, the content generally changes and that's called responsive designs yeah how is that related to foldable? laura morinigo 10 43 yeah, responsive design means that you create your web app, and the web app should be adapted to whatever the screen size of the device is so it doesn't matter if you open your web app into a smartphone, or in desktop, it should look good, right? so developers that are familiar with responsive design, they're not going to find any difficulties adjusting the content to this new devices because right now, foldables, as allows you to have more than one screen at the same time, that the size of the viewport change so you still need to apply responsive design, responsive design is a must that will help your web app, improve its seo and make it accessible and weight foldables is going to bring new functionalities that can be a productivity game changer and even make the tablet experience more portable, and even explore are the different features tony morelan 11 44 now i know with this new technology, it's got to be difficult to start developing for it without having standards so is that something that you're working on for foldables? laura morinigo 11 55 exactly so we know that it's really important for developers to have a certain kind of guidance, and for the users so they can have a really good user experience so in order to do that, we started exploring, which are the right approaches to develop web apps for foldable devices and in partnership with other companies like, for example, microsoft and intel, we started to take up and lead to thinking about responsive design, to take into consideration the different form factor of the screens of the device itself there is currently a standard working draft, that is called device poster, where we actually show to the developer, which is the current posture that the device is having, for example, if it's flip, if it's just in a vertical position also, the developer can take advantage of that information and create cool stuff, of course so what's the best way for developers to get started with developing for foldables? yes, so again, if you already have some experience with responsive design, you still need to apply the same rules to start developing web apps for foldables but besides that, you need to keep in mind that there are new things that you need to implement in order to do that you have some resources in our blog posts, we usually post most of the things that you have to keep in mind new rules or testing that we are doing with these new devices follow the standards that we are actually doing, be part of the conversation and samsung recently launched in its remote test lab, the test to actually test with a ritual foldable device so you can check your web app in that device tony morelan 13 54 so you actually don't have to own a foldable device exactly yeah it's an actual real device from what i understand you're just controlling it online exactly do you have any examples of use cases where developers are taking advantage of foldable devices? laura morinigo 14 09 yes, of course, as i mentioned before, if the user can take advantage of this device, for example, doing multitasking, and so on, developers can do and that's the idea one of the new ways that these phones take advantage to developers are for example, with games users are really excited when they have the chance to play their games in bigger screens so developers are trying to take approach of these advantage and make their web apps will fit into a better screen size to improve the user experience the other way that foldables are changing the game and is like an innovation is the dependent of the posture of, of the device, you can do different things for example, if you have a flip, and if it's in a flip mode, you can actually use your one on one screen to watch video, or even make calls and then you see in the in the in the front screen, the camera, and then in the other screen, you see the console so it's made a better use of currently, what you can do in your web app tony morelan 15 35 yeah, sounds like you can really turn your device into being much more versatile so are there any features coming in the near future that we can get excited about? laura morinigo 15 43 yeah, i think, you know, these initiative was started by samsung, and then other companies followed and i think that's a good case, because it means that it's not just a trend, i believe that these things related with responsive design, and hardware innovation are coming further so even when we talk about dual screen or the way that you sir can see their content so the very first part, i will say, let's see how their users react at these foldable devices, i think most of the feedback is really positive so that means that new things are coming tony morelan 16 28 so what's the best way for developers to follow you and learn more about what you have to offer related to samsung, canada and foldables? laura morinigo 16 36 great, so we usually write our blog posts in samsung internet blog posts, and you can follow us at in our social media samsung internet the same with medium, you can find our articles there in some of the events that we participate soon in my case, you can follow me on twitter, my twitter is paul, this is lada, okay tony morelan 17 01 and i will include all of the links to this in the show notes so you can easily get to those with laura, it was great to have you on the podcast and just wanted to say thanks for giving us a little insight into samsung internet and foldable devices laura morinigo 17 14 amazing and thanks for having me dan appelquist 17 16 by the way, tony, i'm also really excited about the work that laura has been doing with diego from your team around spanish language developer outreach that's a whole another area that we're very committed to in terms of reaching out to more to wider developer and the wider developer community tony morelan 17 35 yeah, that's one thing that i've realized too, is how well we are expanding our reach with not just you know, us or people based in, you know, in in the uk, but we really are reaching out to this global community of developers so it's great to see what diego and laura are doing as far as the spanish speaking developers dan appelquist 17 53 yeah, that's really good so so next, i would like to introduce lola from my team, who is focusing on privacy she has been, amongst other things, participating in the privacy community group in wcc, which is one of the forums in which we talk about emerging privacy technologies that are being added to the web and she's going to tell you a bit about what we're doing in samsung internet when it comes to privacy tony morelan 18 29 hello, and welcome to the podcast lola odelola 18 31 thank you for having me tony morelan 18 33 yeah so tell me what is your role at samsung lola odelola 18 36 so i am a web developer advocate on the samsung internet team got it tony morelan 18 41 so let's talk about privacy and samsung internet knowing that just about everything we do online can be tracked what privacy features are integrated into the samsung internet browser experience that gives users more control over their privacy and their data? lola odelola 18 53 yeah, so the samsung internet actually has a lot of features baked into it that kind of highlight its private nature, if you will one of those features is the privacy dashboard, which shows you the number of items that were blocked in a certain time period it shows you where that blocked backward reis directions or pop ups or apps that open you know, sometimes apps will just try and open the internet, it will show you if there are any apps like that, that it blocks as well so it's quite detailed actually in that regard and it also it also allows you to set settings about if you want warnings about malicious sites, or if you want to block automatic downloads, and is actually in this dashboard where you would set smart anti tracking too, which is another feature basically, smart anti tracking is samsung internet's way of giving the user the ability to say that you don't want to be tracked online so it automatically renews tracking cookies, which are way for basically websites to track your behavior and things online so if you want to switch that setting on, you can do that from the privacy and security dashboard and you can have it to always be in on you can have it to never been on or you can have it to secret mode only, which is like when you have incognito mode or, like when you're in incognito, you can switch off tracking in there, as well so yeah, tony morelan 20 27 so what about ads? how does, you know, i get a lot of ads that always pop up when i'm visiting websites lola odelola 20 33 yeah so the cool thing about the samsung internet browser is that we have the ability to download third party ad blockers and what makes that unique is that you don't have to go to the galaxy store or you have to go to any app store to download these ads because the app store is very heavily integrated into samsung internet, you can actually download them directly from the browser whereas with other internet browsers, you'd have to download from their tony morelan 21 04 app store equivalent sure, sure well, it makes it really easy, then lola odelola 21 07 yeah, straightforward tony morelan 21 09 how can developers learn more about web standards? no, that's pretty important when it comes to developing lola odelola 21 13 yeah, so like, as the web advocate team, we are very involved in web standards and developers can like get to know more about that by following our work, particularly work we're doing so like in the privacy community group, which is public and open to everybody where we discuss things like the global privacy control, it's not yet a web standard, but it's something being worked on by a host of different organizations, different people, from people from the new york times to the bbc, to, you know, lots of different orgs and the idea behind the global privacy control, is that you have a one stop shop to indicate your tracking preferences tony morelan 21 55 so does that mean that users really have the ability then to decide what they want to be tracked? and what they don't want to be tracked? lola odelola 22 03 i'm not quite what it means is that so you know how you go on a website? and it says, hey, do you want to be tracked? and you might say, no, and then you go to another website? and it says, hey, do you want to be tracked? and you're like, no and you know, if you answer no, for one place, you probably mean no, for, you know, everywhere, you probably don't want anywhere tracking you so what the global privacy control says is that instead of having all these different, you know, pop ups that come up, every time you visit a website, that is a one stop shop in your browser, that you can say, i do not want to be tracked, or i do not want my data sold, or whatever the case may be and when a website, when you visit a website, that website should read that signal from that control and then it shouldn't even show you that box, it should even show you that pop up of do you want to be tracked? because it should have already read it? got it? okay okay tony morelan 22 55 okay, great yeah so do any scripts run on the browser or the device? lola odelola 23 03 so no, which is? that's like, what gpc that's kind of what makes it cool that no scripts need to be run on the browser, or the device for this to work is going to be something that that is not going to be reliant on that, basically tony morelan 23 19 so is there any other work that you're supporting within web standards? lola odelola 23 22 yeah, i mean, there's loads and, you know, we don't have time to list them all off now but something else that we are really backing is the private click measurement, which is a way for users’ privacy to protected to be protected by removing tracking data, while still supporting click attribution across sites and it's basically saying, we are not going to allow cross site tracking, but we are still going to collect those clicks but there won't be any unique user data attached to those clicks so you won't be able to follow tony, through his browser history, essentially seen what he's clicked on but you will be able to know that somebody, person t has clicked on these links and you can collect analytics in an anonymous way that way tony morelan 24 11 so i've noticed this sometimes, like, i'll go to a website and next thing, you know, i go over to facebook and now i see that there's an ad that is related to you know, something previously, lola odelola 24 22 yeah, it's kind of similar so basically, what these ad networks do is say, you know, you've got ad network com has an ad on twitter, and you click that ad on twitter, and then you go over to facebook and accident, same ad network com has an ad on facebook, and you click that link, both of those clicks go to ad network com servers, and they are not able to build a profile of you based on the ads that you've clicked on to see what you're interested in so now when you visit you know these sites you do now get ads related to those like these, i mean, basically creates like this like mesh network of clicks around the internet of things you've touched around the internet and build a picture of who you are tony morelan 25 05 so in other words, what you're saying is with private click measurement, only the ad companies know that their ads been clicked, but they're not able to really follow you know, my journey on yeah, okay, gotcha okay so how can developers become more aware of web standards to influence the influence of their work? lola odelola 25 23 um, yeah so as i said before, the best way would be to get involved with wcc, and the web standards work that's happening there now, i will say there is a bit of an accessibility issue because it is member only for some for like the working groups and stuff and you have to pay to become a member however, there are public open free groups, you can be a part of such as the privacy community group, where a lot of web standards get discussed before then we've to work in groups so for example, gpc private clicker measurement are both currently being discussed in the privacy community group and there are other similar community groups as well tony morelan 26 02 right now it says something can we include the link to that in the in the show notes for this podcast? lola odelola 26 06 yes tony morelan 26 07 excellent we'll make sure to do that so what's the best way for developers to follow you and learn more about what you have to offer? yeah, so if anyone's interested, lola odelola 26 17 you can follow me on twitter, i am at lola delilah, and you can check out my writing on the samson internet blog and i think those are the best two places awesome well, tony morelan 26 27 lola, thank you very much for being on the podcast today and just wanted to say thanks for giving us insight into samsung internet and privacy lola odelola 26 34 thank you so much for having me, tony dan appelquist 26 36 it's been great, really great to hear from lola there about some of the things that we're doing to help keep users experience of the web more private so i'd like to introduce ada, from my team who's been focusing on web xr, she amongst other things, is the co-chair of the wcc immersive web working group where she's actually helping to build these standards and she does a lot of work when it on building demonstrators began conferences and events, etc to demonstrate the value and the exciting types of user experiences that can be built using these technologies joining ada, we also have kevin, who will be talking about 5g tours, which is a project that we participate in and we're very excited about putting webex r into action in that project tony morelan 27 34 ada kevin, welcome to the podcast ada rose cannon 27 37 thank you so much for having us it's great to be here kevin picchi 27 40 yeah nice nice being here tony morelan 27 44 so ada, let me first ask what is your role at samsung? ada rose cannon 27 48 so i'm a developer advocate for the web browser samsung internet i'm as well as that i'm also co-chair of the wcc immersive web groups these are the groups that deal with making web xr work in tony morelan 28 01 the browsers and you're located in the uk is that correct? ada rose cannon 28 06 yeah, based out of london and kevin, what about you? what tony morelan 28 08 is your role at samsung? kevin picchi 28 10 so i'm also developer advocates, and i'm also based in the uk office as a doctor but i do understand that tony morelan 28 17 at this moment, you actually are not in london, is that correct? kevin picchi 28 21 exactly i'm in switzerland right now, in doing this tony morelan 28 25 what exactly is web xr? ada rose cannon 28 28 so what they saw is a browser api that lets you access the sensors and displays of immersive hardware via immersive hardware, i mean, things like virtual reality headsets, or augmented reality headsets even your smartphone is an ar capable device, provided it's like a pretty recent one often, modern fast smartphones are able to use machine learning in order to work out your surroundings to do good augmented reality so what the axon lets you build a single experience that runs through the web browser that works on all of these different devices? do you tony morelan 29 04 have to install any applications or plugins or anything, ada rose cannon 29 09 it's great all the user needs to have installed as a browser sometimes if it's not already installed as a requirement by the browser, ar core or ar kit on smartphones may also need to be installed but usually it should just work without needing to install any additional things to save on desktop computers or on particular, headset-based browsers they will also have a built in so if you go to a website, it will show you a scene that's 3d, maybe web gl, you can then push a button and the auto immersive you're in vitality or enter the scene or an ar or let you put the 3d content over your environment and they'll just work with one click of a button you're immersed straightaway and that's really the power of web xr tony morelan 29 57 nice so tell me what would some of the benefits for webxr, ada rose cannon 30 01 there are many benefits from doing xr on the web so one of the really powerful abilities is that because you don't need to install anything from an app store, if you need to charge any money for what you're doing, you won't have an app store taking a cut and that's always just a huge benefit yeah on top of that, you're getting the instant engagement so for example, if i wanted someone to check out a demo i build, i would send someone a url, they would click the url, the page would load in a few seconds, and they push the button and they're able to view it in augmented reality on whatever ar hardware they were using whereas if i don't do a native app, they'd have to download it from an app store they'd have to install it, remember that it's installed, tap on it, open it up, request the permissions, and then they'd be able to enter ar and just to all that process, you end up losing a lot of users so not only is it a better experience for users, but as a as a product owner, you will also have much higher engagement and that's really incredibly powerful tony morelan 31 12 yeah, it sounds like it makes it really easy for people to experience ar and vr so let's talk about some of the equipment that that's needed so how does it support headsets ada rose cannon 31 22 so the headset at the most popular device you'll find today is probably the oculus quest two, which is the latest oculus quest device that came out over christmas it supports virtual reality through web xr out the box through the browser and they're one of the browsers that are really pushing the envelope when it comes to the web xr standards they're doing some really amazing work if you've got a headset, which you would tether to you to your computer, then you'd use it with chrome tony morelan 31 51 if you're worried about something as simple as google cardboard, oh, yes, it actually ada rose cannon 31 55 works out of the box if you have a cardboard headset, and you press enter vr on the phones, it will use the vr core part of android to deliver it through virtual reality, which you can just put into a cardboard headset so that will actually work really well and of course, if you're using any kind of smartphone, whether xr works great on chrome and samsung internet on android devices tony morelan 32 20 so the other day i came across this, what i thought was a really cool website, it was had little dinosaurs that i could click and get inside their cage and actually, you know, scroll around with them and see all the different angles is that a good example of webber? ada rose cannon 32 34 yeah, that's xrdinosaurs com this is a really fantastic example of everything web xr can do it's actually maintained by one of the editors of the webex r spec, which is really cool xr dinosaurs lets you experience the dinosaurs like flat 2d on a computer using normal web gl but if you have ar or vr equipment available, such as a smartphone, you can place the dinosaurs in your environment so if you open it up on a phone, you can push the button and you can view the dinosaur standing around in your living room, which is incredibly cool or if you have a vr headset, you can put it on, and then you will be inside the cage with the dinosaur and then you can walk around it this is a really powerful example of the of the ways where the xr can support multiple different modalities of xr with a single build like there's not running different code for each one, like much of the code for vr and ar is still the same you know, tony morelan 33 36 another example i just realized was, i was shopping for furniture the other day and was on this this website where i could select different lamps, chairs, tables, and actually walk into my living room and place these different items in my living room and turn around and see exactly what it would look like in this environment so again, good example of a web xr ada rose cannon 34 00 that's a perfect example this is the kind of thing that web xr really excels at so anything where it's really small, so where the user probably isn't dedicated enough to actually go out and download an app but they probably still be interested in ar, if it's available anyway, anything like shops or promotional materials, that kind of thing is great, because then they can see it, enjoy it and then when they leave, there's nothing left on their device to clutter them up so there's much less reservation when it comes to actually trying it out and that i think that's really powerful i think the technology used to build that particular demo you were talking about was google's model viewer project and model viewer is fantastic for stuff like store pages and product views you add the script to your page, and then you use the model view or tag to display a 3d model on the page which is already ready to go for augmented reality so if you couldn't get it 3d model of your product in the gltf model format, then it's ready to go and that's really powerful tony morelan 35 06 what i really enjoyed was the fact that there was nothing to download, i clicked a few buttons, and there was, so i can definitely see the benefit where webex are, there isn't that hurdle that somebody has to go over, which is the whole download installation, just to experience it, what would be the best way for developers to get started with web xr? ada rose cannon 35 26 well, if you depend how quickly you want to get started so if you want to get started, and you just you already have the 3d model, and you want to just be done straight away, model viewer is a great place to start it lets you just with a single html tag and a script tag, you can have a 3d model, augmented reality ready in your browser and in your website so that's really great if you want something that's like still html based, and a great way to start if you're more of a beginner, and a frame is a fantastic place to start i'll be honest, i've been doing graphics development for years and i also still use a frame for almost all my products, just because it's so quick to get started but also lets you dive in deep because a frame is based on the library three j s, which is a javascript 3d library for working on web gl, which has been around for a long time is extremely powerful and so a frame kind of gives you the best of both worlds but if you really want to get stuck in with the javascript and really get in with the nitty gritty, working directly with three js, or with babylon js is a great way to go but if you want more of an of a fully like integrated development environment for this kind of thing, so if you prefer the kind of all in one it solution, then there's actually quite a few solutions here so there's amazon sumerian, there's play canvas, which is a fantastic engine and there's a really new one that seems really powerful wonderland engine and of course, as the old classic unity, which has a unity export for what xr tony morelan 37 07 excellent sounds like there's a lot of great tools for developers to get started with, with web xr kevin, let me ask you, how is samsung internet involved with web xr? kevin picchi 37 18 well, we shipped web xi by default inside of browser and we always make sure to ship the latest modules out so the developers can benefit all the good from the tony morelan 37 32 api and what about samsung phones? how well do they work with webxr? kevin picchi 37 37 all of them are compatible? as long as you have the samsung internet browser installed on your phone? you can experience webex are tony morelan 37 45 excellent in ad, i know that you're working also on web standards can you tell me a little bit about web standards, maybe some of the challenges with that? ada rose cannon 37 54 yeah, so as i mentioned earlier, i'm co-chair of the immersive web groups these are the groups that are working on the standards that get built into web browsers that become the api's developers work with to build these experiences and working on the web standards can be really challenging, because people have high expectations for the privacy you'd get from the web like you don't go to a website and expect them to immediately start spying on you through your camera, or doing anything really super dodgy the web browser is there to protect you and because we're adding new api's to the browser, we can't do anything that's going to breach this expectation of privacy and security and because it's the web, it's also got to work for as many people as possible so accessibility is also an incredibly important task so these are the kinds of constraints you've got to work in but on top of this, as graphics developers, we really want to get people working with the very latest features you can find in immersive hardware and we want people to build the kinds of experiences that rival what you can find on native and so balancing these privacy and security expectations against letting people have the most access to the hardware is a real challenge, because a lot of the hardware to do with immersive hardware, such as augmented reality is to deal with revealing more information about the environment and letting the developers work with it so for example, for something like working out where the user can place 3d models in the environment, the underlying engine actually can fully scan your environment and work out what the exact shape of stuff is and its color but this is a lot of information, which is too much that a lot of experiences don't actually need and so it would very easily let someone write an abusive application without giving too much additional functionality so actually the early versions of real-world sensing in web xr just let you query a single point from a single ray at a time so this lets you do stuff like placing a single object on the floor on the walls but we're not exactly scanner through someone's room and this is the kind of balances we have to make and because we have had developers come back to us and say they do need like higher precision, more wide scope, scan, like room scanning this is the kind of thing where we can build an additional api to, to let developers have this but at the same time, we can warn the users that what the developer is trying to do might potentially be more dangerous just like when a website is trying to turn your camera or microphone on, it will warn you yes, in the same way, if the website is trying to get a 3d scan of your entire apartment, we want to warn you about that, too and so this is the kind of balances we have to make tony morelan 41 04 so i know that is one of the big benefits around samsung internet is all of the privacy that you get when you use samsung internet nice to see how that's carrying over to web xr how stable would you say vr is on web xr? ada rose cannon 41 22 so vr itself is very stable, vr was one of the first parts we completed in in web xr, there's actually been vr in the web for like a long time, there was an old api called web vr, that was deprecated last year, but since then, web xr, we pushed very hard to be able to totally replace web vr with web xr with the same capabilities so what vr is pretty stable, i doubt there'll be any more changes to it at all so if you write something, targeting vr, yeah, lots will probably stay the same ar is a little newer and there are newer api's to help with augmented reality so some of the more hit testing, depth sensing stuff, some of this is like a little newer, there may still be some privacy issues that need to be resolved, which may have some interface changes but generally, these are also getting pretty stable a lot of the stuff that might be arriving in the next couple of months, or have arrived in the last month or so might have a few changes so it's important that developers do continue testing that stuff and do keep an eye out for when the api's do change because occasionally, we will get feedback that some that we've developed has a major security flaw we've missed and we can't just leave that out in the wild, we do have to change the api to fix that issue tony morelan 42 50 so are there any new features that you can share related to web standards ada rose cannon 42 55 so there's new features being developed all the time and the really nice thing about web standards is that the develop totally in the open so if you want to see all the latest work that's going on, you can check out the immersive web github, where you can see all of the issues that are being worked on in real time on web xr and all the related modules there’re a few modules i'm really excited about one, which is still super early days would be some kind of dom layer, api that would let us put dom content into a web xr scene so like html elements, and css, this is like kind of a tricky thing to do and it's something we've wanted for a long time and i'm hoping it won't be too far in the future when we eventually get it so what tony morelan 43 42 it is, is, since i am new to web xr, myself, what is dom content? ada rose cannon 43 47 so dom content is like html and css content so like, the normal stuff you'd see on a website, so like, forms, images, buttons, you know, that kind of thing? links, okay, so is this where if i am in either a vr and ar environment, this is where you can actually have like buttons that are clickable within that space? yeah, exactly so in addition to making your 3d environment where the user can grab stuff and pull stuff, and have 3d models, you can also have part of a web page in the environment and that may sound quite boring, because it's just going to be like a 2d rectangle with content in it this lets you use the heck demand css api's that are already available in browsers to build 2d interfaces in vr and ar as well so for example, if you had html form reimplementing, that whole thing out of rectangles and shape in 3d modeling application is kind of a pain, sure, but just being able to write some html and take advantage of all the really powerful 2d layout capabilities of the web is just a fantastic feature and will let developers make the most out of both 3d and 2d tony morelan 45 03 nice, nice yeah so what are some other technologies that go well with web xr? ada rose cannon 45 08 so the first one that comes to mind is like web rtc so this is what lets you do video sharing and audio sharing over the web tony morelan 45 17 in web rtc stands for real time communication, correct? it does, yes ada rose cannon 45 21 so this lets you, for example, if a means kind of some kind of social vr situation, i could do some kind of cool between me and another person so i can chat with them in an efficient manner that's peer to peer without needing to go up to a central service okay and another thing that's really useful for social vr stuff is websockets so websockets lets you do incredibly high bandwidth, very, very fast data connections between your client and the server so you could have many people in a single room, or with having all their positions and rotations shared over websockets so you can see people moving around and walking around in real time and so using their free web rtc is like the kind of the two things you need to get a really good social web experience tony morelan 46 15 so what about the technology, web audio? how was that working with web xr? ada rose cannon 46 20 so web audio is a really interesting api so web xr doesn't actually bother dealing with any audio stuff out of the box there's not like specific information you need for working with audio but the really powerful thing about web audio is that it has stuff like a 3d panner node with hrtf built in so you can already do 3d audio in the web long before web xr came along, which is incredibly cool so you can have correct 3d audio, using the web audio api using the web and it's something that's like a little tricky to set up there's a really great library by google called the resonance project and it lets you like define the surfaces around you so you can say the floor is hard there's no ceiling is where the walls are, and will correctly work out the echoes and the reverb and so you could have multiple sound sources, that will sound really good and you'll be able to know where they are instinctually? because they're done in 3d wow and this is really powerful tony morelan 47 22 yeah, cuz i could see where if you're like moving throughout that environment, your audio is going to be changing the sound reflection from within the room to be able to experience those changes yeah, that seems really powerful ada rose cannon 47 35 yeah, so you can take the information from web xr, for example, the position of the user's head, and then you feed that into a library like resonance and that will automatically handle the correct sound from the user's perspective, which is pretty amazing tony morelan 47 53 yeah so what about 5g? how is webex r and 5g working together? ada rose cannon 48 00 so 5g is totally amazing and this is definitely kevin's cup of tea so he should answer this one kevin picchi 48 06 so 5g would essentially improve your experience using webex so for example, you could have way bigger models downloaded on your phone with a higher quality, and it would simply load faster you could also imagine having multiplayer experiences and having almost zero lag or latency tony morelan 48 29 now, i know that you're working on 5g tours, what exactly is 5g tours kevin picchi 48 34 so 5g tour is a european project in which samsung participates and we test the 5g performances in different environments, in which the first one is touristic environment where we try to enhance the experience of tourists while they're visiting a city there is another one which is the mobility one, we try to enhance the way people move in the city and we also try to improve and create new experiences in a way that we make the city safer so let's say there is an evacuation, we can provide guides and we basically use 5g in all of those verticals to improve them tony morelan 49 19 so to talk a little bit more about making cities more secure or safer what exactly do you mean by that? kevin picchi 49 24 so we have a use case that we're working on internally to take all of it is making evacuation easier and faster by leveraging 5g, for example, have some sort of augmented reality application lunch instantly on the phone after people in the airport and the application would basically guide the people out of the airports in a safe way so let's say there would be a fire and you would be guided around the fire and in the right direction nice tony morelan 49 55 so can you tell me how is samsung internet involved with the with 5g tours? kevin picchi 49 59 well, it's so we're working on basically three sub projects in the 5g tour, where we take advantage of web technologies so what would those technologies be? we're using web xi web rtc, web sockets, and web each id those are the web api that ada just talked about we're trying to fuse them with 5g to improve those verticals tony morelan 50 25 so tell me a little bit more what is web rtc kevin picchi 50 28 one of the use cases we're working on is making museum experience experienceable by multiple people so the goal of it is having two or three persons in a room in a museum room with a piece of art, and being able to have them both in the room and been like letting them experience the artwork, take a look at the artwork, maybe move things around the room and all that taking advantage of 5g, which reduces latency and people tony morelan 51 01 feel better nice and this is in a vr environment is what you're referring to correct? kevin picchi 51 05 yes tony morelan 51 06 so what about web h id, which i think stands for human interface device? is that correct? kevin picchi 51 12 yes that's kind of like the gamepad api in a way that this api lets us send probe packets to the devices so to put it in a simple way, let's say you'd have a remote controller that is not compatible with the gamepad api, you could use this api to basically send bro comments to a controller and you could have some kind of communication going and we're using that api with the remote controller that we're using in another use case, in which were basically communicating with remote and getting sensors data and we're using them as a controller basically tony morelan 51 59 nice, nice to see the versatility of it is there any news coming out that you can share that's related to webex r and samsung internet? ada rose cannon 52 08 web xr is evolving really quickly the best way to keep up to date with new news and events and all the cool stuff that's happening in web xr is to subscribe to the immersive web weekly newsletter it's a newsletter that comes out on tuesdays and is a really great way to stay up to date with everything that's happening in the immersive web world tony morelan 52 26 nicely and we'll include a link to that newsletter in the in the show notes what advice do you have for developers looking to start building for samsung internet and in webex are? ada rose cannon 52 39 probably my best advice is to find an environment you're happy working with i really like a frame, there's quite a few out there, i have a few getting started guides on a website i maintain called immersive web dot dev so it's a great place to look at the different ways you can try out building web xr there's also some really useful tools out there, such as an emulator that lets you emulate immersive headsets in the web browser so you can test your site without needing to actually put on a headset, which is a really great way just to like experiment with stuff as you're building it and is a tool that i use an awful lot right so that's great to hear tony morelan 53 18 so are there other ways for developers to follow you and learn more about by what you have to offer? kevin picchi 53 23 yes, surely we're mostly active on twitter at samsung internet and you can also find our blog and our samsung internet page on the developer samsung com slash internet website you can also follow us here and i on twitter my ad is kevin peaky p icc h ii ada rose cannon 53 46 and mine is at ada rose cannon tony morelan 53 49 well, even kevin, it was great to have you on the podcast just wanted to say thanks for giving us a little insight into samsung internet and web xr ada rose cannon 53 57 thank you so much for having us it's been really good kevin picchi 53 59 yeah thanks for having us sunny dan appelquist 54 03 yeah, so good to hear about what we're doing with web xr and the immersive web i it's a technology that i think is really game changing, especially in the way that it democratizes xu, democratizes, ar and vr and really brings the value of that technology to more people across different types of handsets different types of devices it's really, it's so important we've talked a lot about different aspects of samsung internet, what would be the best way for developers to even learn more? well, you can first of all, visit us on our homepage, which is developer samsung com/internet or you can just click on samsung internet once you go to developer samsung com there you can read about our latest releases, you can read about the team you can have links to all our social media we are samsung internet on twitter, our dms are open there and now account is managed by our team directly so if you're dm’ing, samsung internet, the entire team here will read it and we will try to get back to you but also, if you have bugs or if you have problems, you can use that as a great channel to reach us or you can just add mention us on twitter, and we'll be happy to have a conversation with you there we're also on linkedin, if you search for us on linkedin, samsung internet, you'll find our linkedin page and we're happy to interact there as well we're on medium if you search for samsung internet, again, that's linked from our page at developer samsung com/internet we blog on medium and we also reflect that blog on developer samsung com so that you can see us everywhere you go hey, dan, it was great to have you on the podcast just wanted to say thanks to you and your team, for all the great and exciting things that are coming with samsung internet thanks for the opportunity and thank you for all the work that you've put in closing 55 59 looking to start creating for samsung download the latest tools to code your next app, or get software for designing apps without coding at all sell your apps to the world on the samsung galaxy store check out developer samsung com today and start your journey with samsung the pow! podcast is brought to you by the samsung developer program and produced by tony morelan
tutorials health, galaxy watch, mobile
blogthe samsung privileged health sdk enables your application to collect vital signs and other health parameters tracked on galaxy watch running wear os powered by samsung. the tracked data can be displayed immediately or retained for later analysis. some kinds of tracked data, such as batching data, are impractical to display on a watch screen in real-time, so it is common to store the data in a database or server solution or show them on the larger screen of a mobile device. this blog demonstrates how to develop 2 connected sample applications. a watch application uses the samsung privileged health sdk to collect heart rate tracker data, then uses the wearable data layer api to transmit it to a companion application on the user’s android mobile device, which displays the data as a simple list on its screen. you can follow along with the demonstration by downloading the sample application project. to test the applications, you need a galaxy watch4 (or higher model) and a connected android mobile device. creating the application project the application project consists of a wearable module for the watch, and a mobile module for android mobile devices: in android studio, select open file > new > new project. select wear os > empty wear app and click next. new wear app define the project details. project details to create a companion mobile application for the watch application, check the pair with empty phone app box. notemake sure that the application id is identical for both modules in their “build.gradle” files. for more information about creating multi-module projects, see from wrist to hand: develop a companion app for your wearable application. implementing the watch application the watch application ui has 2 buttons. the start/stop button controls heart data tracking, and the send button transfers the collected data to the connected mobile device. the screen consists of a heart rate field and 4 ibi value fields, since there can be up to 4 ibi values in a single tracking result. watch application ui track and extract heart rate data when the user taps the start button on the wearable application ui, the starttracking() function from the mainviewmodel class is invoked. the application must check that the galaxy watch supports the heart rate tracking capability that we want to implement, as the supported capabilities depend on the device model and software version. retrieve the list of supported health trackers with the trackingcapability.supporthealthtrackertypes of the healthtrackingservice class: override fun hascapabilities(): boolean { log.i(tag, "hascapabilities()") healthtrackingservice = healthtrackingserviceconnection.gethealthtrackingservice() val trackers: list<healthtrackertype> = healthtrackingservice!!.trackingcapability.supporthealthtrackertypes return trackers.contains(trackingtype) } to track the heart rate values on the watch, read the flow of values received in the ondatareceived() listener: @experimentalcoroutinesapi override suspend fun track(): flow<trackermessage> = callbackflow { val updatelistener = object : healthtracker.trackereventlistener { override fun ondatareceived(datapoints: mutablelist<datapoint>) { for (datapoint in datapoints) { var trackeddata: trackeddata? = null val hrvalue = datapoint.getvalue(valuekey.heartrateset.heart_rate) val hrstatus = datapoint.getvalue(valuekey.heartrateset.heart_rate_status) if (ishrvalid(hrstatus)) { trackeddata = trackeddata() trackeddata.hr = hrvalue log.i(tag, "valid hr: $hrvalue") } else { coroutinescope.runcatching { trysendblocking(trackermessage.trackerwarningmessage(geterror(hrstatus.tostring()))) } } val validibilist = getvalidibilist(datapoint) if (validibilist.size > 0) { if (trackeddata == null) trackeddata = trackeddata() trackeddata.ibi.addall(validibilist) } if ((ishrvalid(hrstatus) || validibilist.size > 0) && trackeddata != null) { coroutinescope.runcatching { trysendblocking(trackermessage.datamessage(trackeddata)) } } if (trackeddata != null) { validhrdata.add(trackeddata) } } trimdatalist() } fun geterror(errorkeyfromtracker: string): string { val str = errors.getvalue(errorkeyfromtracker) return context.resources.getstring(str) } override fun onflushcompleted() { log.i(tag, "onflushcompleted()") coroutinescope.runcatching { trysendblocking(trackermessage.flushcompletedmessage) } } override fun onerror(trackererror: healthtracker.trackererror?) { log.i(tag, "onerror()") coroutinescope.runcatching { trysendblocking(trackermessage.trackererrormessage(geterror(trackererror.tostring()))) } } } heartratetracker = healthtrackingservice!!.gethealthtracker(trackingtype) setlistener(updatelistener) awaitclose { log.i(tag, "tracking flow awaitclose()") stoptracking() } } each tracking result is within a list in the datapoints argument of the ondatareceived() update listener. the sample application implements on-demand heart rate tracking, the update listener is invoked every second and each data point list contains 1 element. to extract a heart rate from data point: val hrvalue = datapoint.getvalue(valuekey.heartrateset.heart_rate) val hrstatus = datapoint.getvalue(valuekey.heartrateset.heart_rate_status) a status parameter is returned in addition to the heart rate data. if the heart rate reading was successful, its value is 1. each inter-beat interval data point consists of a list of values and the corresponding status for each value. since samsung privileged health sdk version 1.2.0, there can be up to 4 ibi values in a single data point, depending on the heart rate. if the ibi reading is valid, the value of the status parameter is 0. to extract only ibi data that is valid and whose value is not 0: private fun isibivalid(ibistatus: int, ibivalue: int): boolean { return ibistatus == 0 && ibivalue != 0 } fun getvalidibilist(datapoint: datapoint): arraylist<int> { val ibivalues = datapoint.getvalue(valuekey.heartrateset.ibi_list) val ibistatuses = datapoint.getvalue(valuekey.heartrateset.ibi_status_list) val validibilist = arraylist<int>() for ((i, ibistatus) in ibistatuses.withindex()) { if (isibivalid(ibistatus, ibivalues[i])) { validibilist.add(ibivalues[i]) } } send data to the mobile application the application uses the messageclient class of the wearable data layer api to send messages to the connected mobile device. messages are useful for remote procedure calls (rpc), one-way requests, or in request-or-response communication models. when a message is sent, if the sending and receiving devices are connected, the system queues the message for delivery and returns a successful result code. the successful result code does not necessarily mean that the message was delivered successfully, as the devices can be disconnected before the message is received. to advertise and discover devices on the same network with features that the watch can interact with, use the capabilityclient class of the wearable data layer api. each device on the network is represented as a node that supports various capabilities (features) that an application defines at build time or configures dynamically at runtime. your watch application can search for nodes with a specific capability and interact with it, such as sending messages. this can also work in the opposite direction, with the wearable application advertising the capabilities it supports. when the user taps the send button on the wearable application ui, the sendmessage() function from the mainviewmodel class is invoked, which triggers code in the sendmessageusecase class: override suspend fun sendmessage(message: string, node: node, messagepath: string): boolean { val nodeid = node.id var result = false nodeid.also { id -> messageclient .sendmessage( id, messagepath, message.tobytearray(charset = charset.defaultcharset()) ).apply { addonsuccesslistener { log.i(tag, "sendmessage onsuccesslistener") result = true } addonfailurelistener { log.i(tag, "sendmessage onfailurelistener") result = false } }.await() log.i(tag, "result: $result") return result } } to find a destination node for the message, retrieve all the available capabilities on the network: override suspend fun getcapabilitiesforreachablenodes(): map<node, set<string>> { log.i(tag, "getcapabilities()") val allcapabilities = capabilityclient.getallcapabilities(capabilityclient.filter_reachable).await() return allcapabilities.flatmap { (capability, capabilityinfo) -> capabilityinfo.nodes.map { it to capability } } .groupby( keyselector = { it.first }, valuetransform = { it.second } ) .mapvalues { it.value.toset() } } since the mobile module of the sample application advertises having the “wear” capability, to find an appropriate destination node, retrieve the list of connected nodes that support it: override suspend fun getnodesforcapability( capability: string, allcapabilities: map<node, set<string>> ): set<node> { return allcapabilities.filtervalues { capability in it }.keys } select the first node from the list, encode the message as a json string, and send the message to the node: suspend operator fun invoke(): boolean { val nodes = getcapablenodes() return if (nodes.isnotempty()) { val node = nodes.first() val message = encodemessage(trackingrepository.getvalidhrdata()) messagerepository.sendmessage(message, node, message_path) true } else { log.i(tag, "no compatible nodes found") false } } implementing the mobile application the mobile application ui consists of a list of the heart rate and inter-beat interval values received from the watch. the list is scrollable. mobile application ui receive and display data from the watch application to enable the mobile application to listen for data from the watch and launch when it receives data, define the datalistenerservice service in the mobile application’s androidmanifest.xml file, within the <application> element: <service android:name="com.samsung.health.mobile.data.datalistenerservice" android:exported="true"> <intent-filter> <action android:name="com.google.android.gms.wearable.data_changed" /> <action android:name="com.google.android.gms.wearable.message_received" /> <action android:name="com.google.android.gms.wearable.request_received" /> <action android:name="com.google.android.gms.wearable.capability_changed" /> <action android:name="com.google.android.gms.wearable.channel_event" /> <data android:host="*" android:pathprefix="/msg" android:scheme="wear" /> </intent-filter> </service> implement the datalistenerservice class in the application code to listen for and receive message data. the received json string data is passed as a parameter: private const val tag = "datalistenerservice" private const val message_path = "/msg" class datalistenerservice : wearablelistenerservice() { override fun onmessagereceived(messageevent: messageevent) { super.onmessagereceived(messageevent) val value = messageevent.data.decodetostring() log.i(tag, "onmessagereceived(): $value") when (messageevent.path) { message_path -> { log.i(tag, "service: message (/msg) received: $value") if (value != "") { startactivity( intent(this, mainactivity::class.java) .addflags(intent.flag_activity_new_task).putextra("message", value) ) } else { log.i(tag, "value is an empty string") } } } to decode the message data: fun decodemessage(message: string): list<trackeddata> { return json.decodefromstring(message) } to display the received data on the application screen: @composable fun mainscreen( results: list<trackeddata> ) { column( modifier = modifier .fillmaxsize() .background(color.black), verticalarrangement = arrangement.top, horizontalalignment = alignment.centerhorizontally ) { spacer( modifier .height(70.dp) .fillmaxwidth() .background(color.black) ) listview(results) } } running the applications to run the wearable and mobile applications: connect your galaxy watch and android mobile device (both devices must be paired with each other) to android studio on your computer. select wear from the modules list and the galaxy watch device from the devices list, then click run. the wearable application launches on the watch. connected devices select mobile from the modules list and the android mobile device from the devices list, then click run. the mobile application launches on the mobile device. wear the watch on your wrist and tap start. the watch begins tracking your heart rate. after some tracked values appear on the watch screen, to send the values to the mobile application, tap send. if the mobile application is not running, it is launched. the tracked heart data appears on the mobile application screen. to stop tracking, tap stop on the watch. conclusions the samsung privileged health sdk enables you to track health data, such as heart rate, from a user’s galaxy watch4 or higher smartwatch model. to display the tracked data on a larger screen, you can use the messageclient of the wearable data layer api to send the data to a companion application on the connected mobile device. to develop more advanced application features, you can also use the dataclient class to send data to devices not currently in range of the watch, delivering it only when the device is connected. resources heart rate data transfer code lab
Samsung Developers
Learn Developers Podcast
docseason 1, episode 12 previous episode | episode index | next episode this is a transcript of one episode of the samsung developers podcast, hosted by and produced by tony morelan a listing of all podcast transcripts can be found here host tony morelan product manager, samsung developers instagram - twitter - linkedin guest prasad rayala product manager, samsung electronics in this episode of pow, i interview prasad rayala, product manager for dex, the samsung technology that allows users to extend their galaxy mobile device into a desktop computing experience not only do we talk about the advantages for developers optimizing their apps for dex, but how easy it is to get started listen download this episode topics covered what is dex devices that run dex compatible operating systems optimizing apps for dex dex resources dex sample code security dex features getting started with dex helpful links learn about dex - samsungdex com develop for dex - developer samsung com/samsung-dex samsung dex overview - developer samsung com/samsung-dex/overview dex insights - insights samsung com dex code lab - developer samsung com/codelab dex forum - forum developer samsung com/c/samsung-dex/26 dex whitepaper - insights samsung com/2020/02/12/the-beginners-guide-to-samsung-dex-4/ youtube dex playlist - youtube com/playlist more about samsung dex samsung dex is a new user experience that extends the functionality of your android device to a pc-like environment connect your galaxy to your monitor or tv to bring it to life on the big screen an extension of android n's multi-window mode, there are no proprietary samsung apis needed to launch apps in samsung dex with just a usb cable, unlock your phone's possibilities on pc and mac through samsung dex and now with the note20, you can connect wirelessly to your smart tv using miracast transcript note transcripts are provided by an automated service and reviewed by the samsung developers web team inaccuracies from the transcription process do occur, so please refer to the audio if you are in doubt about the transcript tony morelan 00 02 hey, i'm tony morelan and this is pow! podcasted wisdom from the samsung developer program, where we talk about the latest tech new trends and give insight into all the opportunities available for developers looking to create for samsung on today's show, i interview prasad rayala product manager for dex, the samsung technology that allows users to extend their galaxy mobile device into a desktop computing experience not only do we talk about the advantages for developers optimizing their apps for dex but how he traveled to australia just before covid-19 hit, and with the borders closed he can't come back enjoy so i am super excited to have with me prasad rayala on the podcast i need to first ask who is prasad? prasad rayala 00 48 hey, thanks tony for having me i'm a product manager at samsung electronics america i cover knox mobile enrollment and knox managed products and recently i picked up dex as well and in my role i work with our internal teams to enable them with what's new with these products, how they can be offered to customers, and what challenges customers are facing in implementing these solutions on the other side, i work with our r&d teams to enhance these solutions based on feedback we receive from our customers and partners tony morelan 01 28 so how long have you been at samsung for? prasad rayala 01 31 a total of six years three years with samsung america and three years samsung dubai tony morelan 01 38 i didn't realize that she worked in dubai prasad rayala 01 40 yeah, but three years and then i moved to samsung us tony morelan 01 44 did you study tech when you were in college? prasad rayala 01 48 i am an engineer, but i studied civil engineering, how to construct buildings and bridges but i moved to it i started my career with as a programmer on the midrange systems is foreign during the y2k era, i then moved to java programming language and i've been working outsourcing company in india for over a decade while i was with them, i was posted to dubai, to manage the customer relationships there while i was in dubai, i came across an opportunity to join samsung to manage a large scale smart learning project where about 400 classrooms across the country need to be digitized with large displays in the classrooms and also provide devices for students to consume the content that was in 2013 and after completing the project, i moved to the mobility side and the knox was just launched at that time, and i was cast to spread the awareness of narcs work with partners the ecosystem, just take it to the market and i continued in that role for about three years and in 2016, i moved to the us and joined a global knock solution engineering team and since then i've done different roles like solution engineering, partner management, project management, and now product management tony morelan 03 21 you know, i recently did a podcast interview with the knox partner program prasad rayala 03 25 yes, those are excellent yeah i mean, it's a great initiative, how to help partners, build their solutions, get support, and actually work with samsung in promoting those solutions it's a nice platform tony morelan 03 39 see, it mentioned that you eventually made it to the us tell me where are you based out of right now prasad rayala 03 44 i work out of our mountain view office in the bay area we also have the north america or us r&d team also operates from majority of the knox r&d teams, engineering, product managers work out of that office as well tony morelan 04 00 is that where you're at right at this moment, prasad rayala 04 02 as of this moment, i'm in melbourne, australia my family lives here and i came to visit them, middle of march and since then, i'm stuck here because of the border closures on both sides so i continue to work remotely leveraging all the technical capabilities my company provided, including decks, tony morelan 04 24 like i can imagine what that must be like, you know, glad to know that you and your family are safe and that you're able to continue working hopefully soon, the borders will open and you'll be able to come home but i'm just not sure when that's gonna be let's talk a bit more about dex now, what exactly is dex? prasad rayala 04 41 so samsung dex is a software platform that extends your smartphone or tablet into a desktop computing experience it is built into many of the latest samsung smartphones and tablets it's free you don't have to buy anything lily to get started using decks is just a monitor, hdmi adapter and peripherals like keyboard and mouse and with our latest galaxy note 20, you can use decks wirelessly on most of your tvs that support mirror cast the best part is while you are running decks on the monitor, you can continue to use your device at the same time so you're attending a video conference on the biggest screen, but you can also take notes or browse through your emails on your device at the same time tony morelan 05 33 so i know my first experience with decks was a little over a year ago and back then i actually had to stick it into a cradle so you're saying now it's prasad rayala 05 43 it's miracast? yes, you connect your larger display to mirror cast wirelessly when dex was launched with galaxy s eight yes, there were a couple of hardware accessories like cradle was required to plug it in we graduated from their two wireless connectivity now there are certain limitations like how many number of apps you can run while you're connected wirelessly but you have the option of just going into a meeting room connecting to a display wirelessly and running your presentations off your phone tony morelan 06 18 so can you tell me where did the name dex come from? what does that mean? prasad rayala 06 22 yeah, anything ending with x is very catchy, right? but dex is a short version of desktop experience so when you activate it by connecting your phone or tablet or monitor you get the familiar look and feel of a desktop environment with features and functions you're used to like multiple and resizeable, windows, keyboard shortcuts, and drag and drop etc tony morelan 06 51 do users need to install any special apps or using these special api's to enable samsung dex on their devices? prasad rayala 06 58 no, no special application required, it's pre built on the device firmware you don't have to install anything we just need to connect device to a monitor with the cable and dex will launch automatically an it administrator on the other side can control the text experience like allowing or disallowing enabling decks and choosing which applications can run index mode okay, this can be done using their preferred e&m solution tony morelan 07 27 definitely for security that's an important aspect is dex only compatible with android? or is it compatible beyond android os prasad rayala 07 36 so dex can be used in three different variations to meet various needs first, you can use it by connecting your samsung android device to a monitor or you can run it in standalone mode on the tablet screen without connecting to a monitor or you can use your pc or mac by installing an application on the mac or pc and connect your device through usb cable and run dax on your existing laptop or mac but the experience itself is powered by the software in both on samsung smartphones and tablets, tony morelan 08 15 so what applications can i use index mode? prasad rayala 08 18 pretty much any android application that's running on your device can be run in dex mode, all your favorite business applications like microsoft office, mobile suite, adobe apps for creative professionals, video conferencing apps like microsoft teams, webex, zoom bluejeans, etc wow, okay yeah, and if you are relying on legacy windows applications that do not have mobile or web versions, you can use virtual desktop applications like vmware or citrix within dex to access a full windows desktop from your phone and it's not just all work, you can have some fun too you can play your favorite games on a biggest screen and use your keyboard mouse gaming keyboard and mouse to play to control the game experience on a bigger screen tony morelan 09 14 wow, i didn't know that that's, definitely a great advantage yeah so let's talk a bit about developing for deck so if i'm a developer, why should i optimize my app for decks? prasad rayala 09 24 yeah, based on some market research, we found the majority of it workers use two or more devices for work, phone, laptop, tablet, laptop, desktop, etc at least two when multitasking between these devices, productivity is lost due to compatibility between the operating systems and applications samsung dex minimizes this fragmentation by bringing pc like experience to your mobile devices applications optimized for dex can take advantage of android's multi window features where users can open multiple apps in the same session to work, connect, and interact seamlessly together because these applications will be running on a larger screen index mode, you can use additional features like drag and drop files between windows copy paste between multiple applications and navigate between apps with your familiar keyboard shortcuts tony morelan 10 29 you know, we talked a little bit about covid how you're in australia at the moment because of the borders you know, pretty much the country is working from home so can you talk a bit about the benefits of developers optimizing their apps considering that people are now working at home more? prasad rayala 10 45 yeah, i mean, the the obscene shift in many things that we are usually doing say working from home for an hour is different from working from home for six months teaching kids for a couple of hours from home is different from remote learning toward the day so enabling the secure and productive work from home setup is one of the core use cases of tech's imagine you're about to jump onto a video conferencing call with your team on your laptop, and it decides to go through a noise tony morelan 11 21 yes, yes, prasad rayala 11 22 right at that moment, or you get a blue screen you don't have to reschedule your call, you can just connect your phone to the monitor and fire up your decks and join the call you can continue checking your emails, take notes or even collaborate with your team by sharing your screen while you are on the video conferencing kind of launch through decks if you need access to windows native applications, yes, you can fire up video solution like citrix or vmware and if you have an application running in education space to say students will be able to utilize a large screen to access your solution and use the s pen on the tablets to take notes while attending a session tony morelan 12 08 that's great with this whole distance learning, any sort of tools that we can offer to our students to yeah, to help is prasad rayala 12 14 definitely a huge benefit so my son school is using google classroom and they share a lot of material for kids to work on some math worksheets, etc he's been printing them and writing on them and scanning and sharing with their teachers i told him, why don't you use your s pen so now he's converting it into a pdf? he's editing writing on the tablet itself, just saving it locally and sharing with his teachers we're reducing a lot of printing at home and saving some yes, tony morelan 12 52 definitely definitely that's great so what has samsung decks done to drive awareness for developers prasad rayala 13 00 yeah since the launch of deck samson has worked closely with the developer community in enabling business applications to take advantage of the benefits offered by decks every year at samsung developer conference there are dedicated talk tracks and hands on labs were offered a lot of articles and videos around how dex is enabling certain use cases in verticals like public safety, health care, and education these are published on samsung insights portal and there is a dedicated section on the developer website for samsung to help developers start the journey and optimizing their apps for tax tony morelan 13 43 that's excellent any chance that there's some sample code out there for developers who want to take a look at it and understand a little bit more? prasad rayala 13 49 absolutely there are hands on videos on the developer samsung com how to optimize the applications and there is some sample code explaining each optimization they can do these videos are great like, you can just pause them and make changes to our app and there are instructions on how to test your application, how it's running on dex, etc there are a lot of resources on developer samsung com tony morelan 14 18 that's, that's great so we talked a little bit about your experience with knox so let's talk about what has dex done related to security prasad rayala 14 27 so dex doesn't really interfere with security it fully complies with the policies set by administrator through the mmm say you want to attach a picture you took on your phone to your email and if your administrator has blocked access to the usb ports on your laptop, for security reasons how will you send your picture to your email you will either email it to yourself or to a third party cloud store is both are not productive enough not secure enough so with decks, you'll have that seamless access of your local files on your device, which you can just drag and drop these files onto your email client running on your device itself so no more emailing it yourself or uploading to a third party file sharing system you can also leverage your biometrics to set up samsung pass on on your device to access your online accounts without having to type in your password every time on the personal side if you are using the secure folder where you might have installed sensitive applications, like banking or you store sensitive information, you can continue to use it dex won't interfere with secure folder tony morelan 15 49 so i had mentioned earlier that the version of dex that i had was where i put my device into a cradle so i know that dex has evolved so talk a little bit about where dex originated from and but it's become prasad rayala 16 00 yeah then so the mobile devices is not designed to run multiple applications at the same time right so yes, there can be background applications running but user typically interacts with to one application at a time there is no multi window but as dex enables this multi windows feature, the device can heat up pretty quickly so the first version of dex when it was introduced on galaxy s eight, there was a docking accessory called the deck station or a dex pad was required to start the desktop experience and connect to peripherals so these accessory had a little fan inside to keep the device cool and ports to connect your keyboard and mouse and hdmi back your monitor with node nine, the need for these docking accessories really was eliminated by introducing the next hdmi adapter simple cable or a multi port adapter if you need to connect your peripherals in 2019 with the launch of node 10 decks for pc was introduced i talked before where you can install an application on your pc or a mac and access decks right from your computer with no today don't need any wires, any cables, you can just connect your phone to your miracles supported this tvs wirelessly tony morelan 17 29 so you had mentioned a little bit about multi window are there any other specific types of optimizations? that can be done? prasad rayala 17 36 yeah, i think minimum decks optimized application should support multiwindow keyboard mouse inputs and handle runtime configuration changes generally, if an app follows best practices of android programming, it will successfully run index mode without any code changes okay? there are no samsung specific sdk to integrate our api's to call multi window support enables minimizing, maximizing and resizing the application window only the manifest file needs to be updated to support this feature to enable keyboard and mouse support, you just do not explicitly declare touch screen support in your manifest and keep in mind that when an application switches between mobile and dex mode, runtime configurations change, this is similar to an orientation change from portrait to landscape these runtime configuration changes may result in forcing the application to restart when switching between mobile and x mode you don't want a webex session that you joined from phone to restart when you launch decks mode to avoid this, just follow androids guideline on handling configuration changes and best practices for building a responsive design that seems tony morelan 18 51 pretty straightforward what about some new decks features like finger gestures are drag and drop? prasad rayala 18 57 yeah, so drag and drop, copy paste these features have been there, right from the beginning the finger gestures you're mentioning is how you use your device screen as a touchpad when you are in dex mode by connecting your device to the monitor if you do not have a mouse, you can convert your device screen as a touchpad to interact with decks and run just like a traditional touchpad on a laptop a single tap on your phone screen is same as your mouse left click, a double tap is like a right click, you can pinch your fingers to zoom etc tony morelan 19 35 so what types of apps then are developers optimizing for decks? prasad rayala 19 39 so any application used in a workplace setting right? productivity suites, your vdi applications video conferencing, or specific vertical focused applications like say healthcare or education these are all applications that can be optimized any application that can benefit from a desk stop experience running on a larger screen is a candidate for optimization it's not just limited to, again, work apps, you can optimize some of your games as well, if you will, that games can be educational my daughter is learning how to count by twos, threes, fours, she just started her multiplication and there are a lot of lessons out there router gamified and instead of watching those on a seven inch screen or a 10 inch laptop, i'm letting her watch those things on my samsung tv on a larger screen, and she's happy with it tony morelan 20 41 oh, that's that's excellent so let's talk about some of the challenges is a dex had to face any challenges that you can share? prasad rayala 20 48 yeah, so with dax, our goal is to close the gap between desktop and mobile computing experiences it won't happen overnight we need to build an ecosystem around next to support different use cases, we are pretty confident about meeting their mobile workers needs but we know we have some work to do in other verticals we are investing heavily in enhancing the core capabilities of the device itself to support different vertical use cases, along with live raising capabilities of our partners there are some exciting things on the roadmap so watch this space through this year and early next year tony morelan 21 30 excellent so let's talk about some of the areas of success then what can you share that that you're proud of the dex has accomplished prasad rayala 21 37 so we've seen dex adopted in almost all industries, saying healthcare of patient experiences improved to seamless continuity from doctors workstation to patient rooms and back again in retail the associate can use a single device to say browse through inventory, check prizes, or ask assist customers with checkouts all with a single device say in public safety officer can use his mobile phone while in the field or inside the vehicle or at the station, say in a insurance or construction space, you can consolidate your hardware so you have access to everything you need while in the field without having to go back and forth between devices so we we continue to work with our partners and customers now to identify different use cases in retail bank branches there's a nice use case where the bank associate can interact with the customer to a dual screen kind of mode where associate will be accessing, say presenting different loan options or critical options to the customer and the customer will be using a tablet or filling his or her personal information, both sharing the same device so they're nice use cases we are discovering our customers are help improving the product with the use cases they have in the specific vertical businesses tony morelan 23 15 yeah, and i, you know, i can totally see where you know, we're in the middle of this pandemic with covid it's pretty obvious that even when we get beyond this pandemic, i think our society is going to be making a shift towards how we're conducting a lot of our, you know, day to day business so just your example there of how working with bank institutions, and being able to share screens, but yet, stay within your device, i think is very, very advantageous, right so what advice do you have for developers looking to get started modifying their apps for decks, prasad rayala 23 49 so if you have never experienced vertex, you don't know how your application looks and feels on a larger screen just start simple enabled multi window keyboard shortcuts and just connect your device, launch your application and just see the magic these changes do not require any change in your core and just the manifest file, you can just make some changes and run it once you see how it runs on a larger device with resizable, windows and drag and drop, etc, then it'll force you to think outside that seven inch screen your application is designed to run on or you can then go on and explore more and provide unique features like the contextual menu, or using their mouse wheel to zoom in, say you have a map solution in your application you can use your mouse wheel to zoom in and out of the map, etc that's great tony morelan 24 45 so for a developer that wants to get started, what's the best way for them to learn more? is there a website that they can go to? prasad rayala 24 53 yeah, i mean, to understand what specific solutions are best optimized for dex checkouts samsung dex com it gives an overview of the solution itself, how it runs, how to enable it, what device is it run on, etc and while you're there, just go to text for business section to understand how it's used in different verticals you may be operating in a specific industry, it will help understand how dex is enabling use cases in that industry and there are a lot of videos on youtube on just decks both from samsung team and independent analysts users out there who tried decks for different use cases and finally, when you ready to start optimizing your application, go to developer samsung com and go to the deck section and follow the instruction start simple and just start optimizing your app tony morelan 25 49 that's that's great that sounds actually pretty darn pretty darn easy yeah so are there any news or any events coming up that we can get excited about from decks? prasad rayala 25 58 so as much as we wanted to be in front of our customers and partners but we couldn't do so with covid so we are going as much detail as possible have we had a two day virtually experience event in july where industry experts advised how businesses can adjust to the new normal we have also launched a series of online events called samson together, where we host one hour session with our partners to introduce new solutions we are bringing together to help our customers navigate these difficult situations we covered decks in detail in the last episode, very hands on demonstrations and use cases discussed etc so check out samson together this a series of one hour sessions and the last session covered decks in detail tony morelan 26 52 that's great that's great thank you for that and i will be linking to all of this in the show notes for this episode so make it easy for for our listeners to find those pages if people want to contact you or the decks team, what is the best way for them to do that? prasad rayala 27 06 so the instructions www developer samsung com are pretty self explanatory, a lot of videos and sample code, etc but if you still need help or send in a request with your question inside that portal, there is a dedicated team around the clock to help you with your classifications wherever you are in the world, there is a team in your timezone of answering your questions, make use of that contact form on the www developer samsung com tony morelan 27 36 excellent so a couple of last questions for you so the first thing i want to ask is, when you're not working, what do you do for fun? prasad rayala 27 44 so can you really say when you're not working now that you are at home and you're always hooked on to work? there is no there is no distinction between you're at work at home, you're always tony morelan 27 58 okay, so when you're outside and you're under plugged prasad rayala 28 00 so yeah, mostly i spend my time with my family also my work my toolkits keep me busy helping them with these remote learning or just keeping them busy when when they're not learning but if i can still sneak out some time, while mostly be exploring my neighborhood by walking, i love to go on slow, long walks and probably some hikes tony morelan 28 28 so the last question you had mentioned that you were studying as a civil engineer, and then you actually got to spend time in dubai what was that like with the i'm sure you were amazed with all the buildings that you saw there prasad rayala 28 40 to divide goes to the cycles of real estate boom and bust right when it's booming you you could see thousands of these cranes set up they do go vertical, because they need to make use of the limited the space they have they can't spread out so they go vertical in minimum you'll see like 3050 floors and all that so samsung office was on 51st 52nd floor and we could from there the palm jumeirah, clearly it there are a lot of engineering marvels a lot of great architecture there is a twisting and rotating tower so builders are competing to meet new and unique designs of their most challenging work environment, right, the temperatures constantly about 130 140 sometimes, it's very challenging sometimes it's just fun tony morelan 29 40 well, hey, prasad i absolutely appreciate you taking the time to join me on the podcast thank you very much prasad rayala 29 44 thanks, tony thanks for having me outro 29 47 looking to start creating for samsung, download the latest tools to code your next app, or get software for designing apps without coding it all sell your apps to the world on the samsung galaxy store, check out developer samsung com today and start your journey with samsung the pow! podcast is brought to you by the samsung developer program and produced by tony morelan
We use cookies to improve your experience on our website and to show you relevant advertising. Manage you settings for our cookies below.
These cookies are essential as they enable you to move around the website. This category cannot be disabled.
These cookies collect information about how you use our website. for example which pages you visit most often. All information these cookies collect is used to improve how the website works.
These cookies allow our website to remember choices you make (such as your user name, language or the region your are in) and tailor the website to provide enhanced features and content for you.
These cookies gather information about your browser habits. They remember that you've visited our website and share this information with other organizations such as advertisers.
You have successfully updated your cookie preferences.