{"id":8813,"date":"2020-02-18T08:00:10","date_gmt":"2020-02-18T16:00:10","guid":{"rendered":"http:\/\/softwareengineeringdaily.com\/?p=8813"},"modified":"2020-11-10T14:00:37","modified_gmt":"2020-11-10T22:00:37","slug":"linkedin-data-infrastructure","status":"publish","type":"post","link":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/","title":{"rendered":"LinkedIn Data Infrastructure"},"content":{"rendered":"

LinkedIn has become a staple for the modern professional, whether it\u2019s used for searching for a new job, reading industry news, or keeping up with professional connections.\u00a0<\/span><\/p>\n

As a rapidly growing platform that serves <\/span>more than 675 million users<\/span><\/a> today, LinkedIn is a company that can boast of having one of the largest user bases in the world. How these users interact with the site and react to recommendations aggregates into a massive dataset. On a scale that not many companies experience, LinkedIn has a large amount of data that brings interesting engineering problems and opens up ripe opportunity for innovation in areas like data infrastructure and tooling.<\/span><\/p>\n

Even though LinkedIn is a 16-year-old company, its data infrastructure journey is far from over. LinkedIn\u2019s infrastructure quest covers a wide range of practices, having <\/span>approximately 20 servers in a small data center in 2008<\/span><\/a> to building smarter data centers around the world, and more recently, as of July 2019, having begun a multi-year migration to the public cloud with Azure. Throughout this journey, LinkedIn engineers have faced a variety of challenges and documented their solutions as lessons to be learned along the way, as well as built and open-sourced invaluable tools like Kafka and Voldemort, used by millions of other engineers.<\/span><\/p>\n

In the early years of LinkedIn, the data infrastructure relied on a single data center, hosted with a retail data center provider. In those days, the priority, with data being served from a single data center, was availability – <\/span>keeping the site up for users<\/span><\/a>.<\/span><\/p>\n

As the number of users grew and new features were released, adding data center capacity through a retail provider became less cost-effective. This is when LinkedIn started its own data center, gradually fanning out to rely on multiple data centers. By not only expanding their data centers in number, but also <\/span>designing the fabric of the data centers in a smart way<\/span><\/a>, LinkedIn grew into its modern infrastructure, able to handle millions of users.<\/span><\/p>\n

LinkedIn has showcased a multi-perspective strategy on handling growth. The most prominent strategies have been expanding the number and the capacity of data centers, building smarter data centers, and creating tooling around massive data to enable faster integration of data into workflows to propel innovation.<\/span><\/p>\n

 <\/p>\n

Data Sources at LinkedIn<\/b><\/h2>\n

LinkedIn has a couple of main sources of data, as Kapil Surlaker explains in our <\/span>episode on the company\u2019s data infrastructure<\/span><\/a>.\u00a0<\/span><\/p>\n

The first source is transactional data from the users: every action taken by a user in the form of status updates to post \u201clikes\u201d and job views must be stored. The second source is telemetry data, which comes from monitoring applications to gain insight into how the different components of the platform are performing. The third source, one without an upper bound according to Surlaker, is derived data, generated by developers for numerous purposes such as data sets to be used for analysis and building machine learning models.<\/span><\/p>\n

These types of data are common for web applications with user interactions. Things get complicated when data has to be consolidated in a standard format to enable a unified experience for the developers in a company.<\/span><\/p>\n

The data sources can be widely different – historical data usually comes from RDBMSs designed for OLAP, current transactional data comes from NoSQL databases and streams, and logs can be delivered in a variety of formats. In which paradigm the data comes in is also important: ingesting streaming data and using batch data may have different requirements.<\/span><\/p>\n

LinkedIn\u2019s main answer to handling these diverse sets of data has been through tooling. Luckily for the general developer community, many of these tools have been open-sourced over the years.<\/span><\/p>\n

 <\/p>\n

Open Source Tools<\/b><\/h2>\n

One of LinkedIn\u2019s strategies for dealing with the massive amounts of data that are being constantly generated is to empower engineers by developing tools to deal with different aspects of the data, from ingestion to storage.\u00a0<\/span><\/p>\n

\"\"<\/a><\/p>\n

LinkedIn has <\/span>built and open-sourced a variety of tools over the years<\/span><\/a>. One of these tools, <\/span>Kafka<\/span><\/a>, built by LinkedIn and donated to Apache Software Foundation, forms the backbone of data operations at LinkedIn alongside Hadoop. Kafka, a distributed streaming platform, acts as a low-latency data collection system for the real-time data generated by LinkedIn\u2019s user base.<\/span><\/p>\n

Complementing Kafka is a tool called <\/span>Gobblin<\/span><\/a>, a distributed data integration framework. Gobblin is used to <\/span>ease and unify the integration of data<\/span><\/a> between different sources and sinks, providing scalability, fault tolerance, and quality assurance in one tool. <\/span>Developed initially to serve as an \u201cuber-ingestion framework\u201d for Hadoop at LinkedIn<\/span><\/a>, Gobblin was open-sourced and donated to Apache where it has taken on new integrations and a diverse community of committers.<\/span><\/p>\n

\"\"<\/a><\/p>\n

Project InVersion<\/b><\/h2>\n

In the fast-moving world of startups, technical debt is often overlooked. It refers to an <\/span>accumulation of deficiencies that make it harder to add new features to the system<\/span><\/a>. The most common way of accumulating technical debt is by releasing features quickly without thinking of the future sustainability of the overall system, a practice that is prominent for startups that are looking to attract users and investors with shiny new features.<\/span><\/p>\n

Technical debt occurs in many ways<\/span><\/a>, and it\u2019s not always easy to prevent it. Developers at LinkedIn faced their technical debt in a hard way.<\/span><\/p>\n

In 2011, after the company\u2019s initial public offering, LinkedIn\u2019s technical debt hit a critical point. Practices in the infrastructure that had been in use for years and problems that were compounded as new features were added on top of them could not be held down anymore. LinkedIn went for a risky infrastructure overhaul, now referred to as Project InVersion.<\/span><\/p>\n

For two months in 2011, <\/span>LinkedIn stopped rolling out new features<\/span><\/a> as developers focused on improving and modernizing their infrastructure – a full team effort to get rid of the technical debt of the last eight years. This overhaul included developing new tools that automated testing, accelerated the process of rolling out features and updating the platform, and in the end, completely transformed LinkedIn\u2019s backbone.<\/span><\/p>\n

 <\/p>\n

Challenges with ML<\/b><\/h2>\n

LinkedIn offers a personalized experience to each of its users. The way that <\/span>posts in their feed are sorted<\/span><\/a>, the job recommendations they see, and other recommendations need to be specific for everyone on the platform. The main power behind these operations are machine learning models.<\/span><\/p>\n

\"\"<\/a><\/p>\n

An example from recommendations on LinkedIn, powered by AI.<\/span><\/i><\/p>\n

LinkedIn has many teams for each ML application, from Feeds to Communities. Each of these areas poses unique challenges in defining the right objectives, applying the correct modeling technique, and successfully serving complex models with low latency at scale. Each model must be tightly integrated within the serving stack specific to its problem space. At the same time, there must be a single unified framework that provides a battery of tools to solve the myriad challenges that come with dealing with complex models that operate on a very large set of data.<\/span><\/p>\n

LinkedIn\u2019s solution is Pro-ML.\u00a0<\/span><\/p>\n

The goal of Pro-ML is to double the effectiveness of machine learning engineers while simultaneously opening the tools for AI and modeling to engineers from across the LinkedIn stack.<\/span><\/p><\/blockquote>\n

Source<\/span><\/a><\/p>\n

Pro-ML approach divides ML practices into layers as part of the machine learning development lifecycle<\/span>
\n\"\"<\/a><\/p>\n

Each of these layers is a step towards building machine learning models for production. LinkedIn finds it helpful to standardize these steps so that engineers across teams can share innovations by simply swapping components with one another. We also provide automation and additional hints to help users find mistakes in their models faster.\u00a0<\/span><\/p>\n

In machine learning parlance, a \u201cfeature\u201d is a piece of the data that the model uses to make a prediction. An example might be how many connections in common a user has with someone who posted an item in his or her feed. Features used in various machine learning models are collected into the Feature Marketplace in a searchable format. These features are available when making predictions when the user visits the site, but must be simulated when testing out an idea during model training. LinkedIn has had many challenges in the past with ensuring features are computed the same way during model training and prediction. Pro-ML offers a tool called Frame that unifies feature access and computation in all of the environments.<\/span><\/p>\n

LinkedIn also has several open-source tools to integrate machine learning workflows into their infrastructure needs, such as <\/span>TonY<\/span><\/a> and <\/span>Photon ML<\/span><\/a>.\u00a0<\/span>
\n\"\"<\/a><\/p>\n

TonY, originally an acronym for TensorFlow on YARN, was developed <\/span>out of a need to run distributed deep learning training jobs on large Hadoop clusters<\/span><\/a>. Because other options such as TensorFlow on Spark fell short for LinkedIn\u2019s specific needs, such as lack of GPU scheduling, an internal tool was created and later open-sourced. TonY currently supports not only TensorFlow, but also PyTorch and MXNet.\u00a0<\/span><\/p>\n

Photon ML<\/span><\/a> was built out of similar needs as a machine learning library on Spark. Rather than deep learning, Photon ML focuses on Generalized Linear Models and Generalized Linear Mixed Models (GLMix). These models built by Photon ML power features where response prediction is useful, namely for recommendation components such as job recommendation, feed ranking, and \u201cPeople You May Know.\u201d<\/span><\/p>\n

\"\"<\/a><\/p>\n

Journey to Cloud<\/b><\/h2>\n

LinkedIn <\/span>has been using Azure for some of its operations<\/span><\/a>, such as Microsoft\u2019s <\/span>Content Moderator APIs<\/span><\/a> as part of Cognitive Service for detecting inappropriate content and <\/span>Text Analytics APIs<\/span><\/a> for <\/span>machine translation<\/span><\/a>. The choice to use Azure services from Cognitive Service is an important point: LinkedIn has proven over the years through numerous projects built and open-sourced by its engineers that the company is not averse to tackling a problem from the root and developing the necessary solution. There is a trade-off, in terms of the developer effort put in by engineers in LinkedIn and the cost of using a service from a provider. Beyond this trade-off, however, comes the question of reliability and scale, especially for a company like LinkedIn, unique in the amount of data and number of users its platform serves.\u00a0<\/span><\/p>\n

Recently, Senior VP of Engineering of LinkedIn, Mohak Shroff <\/span>announced<\/span><\/a> that the company will be making the switch to the public cloud under the umbrella of Azure. This is a critical move, and a deliberate one, according to Shroff – periodically weighing the pros and cons of public cloud from a multi-faceted approach, ranging from applicability to the bare economics, the company recently decided that it would be a worthy next step.<\/span><\/p>\n

These considerations are significant. The decisions to use Azure services show the company\u2019s trust in Azure to handle some of the data operations on the scale of LinkedIn.<\/span><\/p>\n

To learn more about what the engineers over at LinkedIn are building to connect the world\u2019s professionals, check out the company\u2019s <\/span>blog<\/span><\/a>.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

LinkedIn has become a staple for the modern professional, whether it\u2019s used for searching for a new job, reading industry news, or keeping up with professional connections.\u00a0 As a rapidly growing platform that serves more than 675 million users today, LinkedIn is a company that can boast of having one of the largest user bases<\/p>\n","protected":false},"author":15,"featured_media":10159,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[1363,83,2143],"tags":[2120,323,3510,2402,3329,336,311,282],"class_list":["post-8813","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-all-episodes","category-articles","category-exclusive-content","tag-data-infrastructure","tag-deep-learning","tag-gobblin","tag-gokhan-simsek","tag-kapil-surlaker","tag-linkedin","tag-machine-learning","tag-open-source"],"jetpack_publicize_connections":[],"acf":[],"yoast_head":"\nLinkedIn Data Infrastructure - Software Engineering Daily<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"LinkedIn Data Infrastructure - Software Engineering Daily\" \/>\n<meta property=\"og:description\" content=\"LinkedIn has become a staple for the modern professional, whether it\u2019s used for searching for a new job, reading industry news, or keeping up with professional connections.\u00a0 As a rapidly growing platform that serves more than 675 million users today, LinkedIn is a company that can boast of having one of the largest user bases\" \/>\n<meta property=\"og:url\" content=\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\" \/>\n<meta property=\"og:site_name\" content=\"Software Engineering Daily\" \/>\n<meta property=\"article:published_time\" content=\"2020-02-18T16:00:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-11-10T22:00:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Gokhan Simsek\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@GokhanSimseek\" \/>\n<meta name=\"twitter:site\" content=\"@software_daily\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Gokhan Simsek\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\"},\"author\":{\"name\":\"Gokhan Simsek\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/e890d5bb8941fc76fb69909e6702c34d\"},\"headline\":\"LinkedIn Data Infrastructure\",\"datePublished\":\"2020-02-18T16:00:10+00:00\",\"dateModified\":\"2020-11-10T22:00:37+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\"},\"wordCount\":1793,\"publisher\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1\",\"keywords\":[\"data infrastructure\",\"Deep Learning\",\"Gobblin\",\"Gokhan Simsek\",\"Kapil Surlaker\",\"LinkedIn\",\"Machine Learning\",\"Open Source\"],\"articleSection\":[\"All Content\",\"Exclusive Articles\",\"Exclusive Content\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\",\"url\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\",\"name\":\"LinkedIn Data Infrastructure - Software Engineering Daily\",\"isPartOf\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1\",\"datePublished\":\"2020-02-18T16:00:10+00:00\",\"dateModified\":\"2020-11-10T22:00:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1\",\"width\":2048,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/softwareengineeringdaily.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"LinkedIn Data Infrastructure\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#website\",\"url\":\"https:\/\/softwareengineeringdaily.com\/\",\"name\":\"Software Engineering Daily\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/softwareengineeringdaily.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#organization\",\"name\":\"Software Engineering Daily\",\"url\":\"https:\/\/softwareengineeringdaily.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2024\/01\/cropped-sed_website_banner.png?fit=549%2C169&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2024\/01\/cropped-sed_website_banner.png?fit=549%2C169&ssl=1\",\"width\":549,\"height\":169,\"caption\":\"Software Engineering Daily\"},\"image\":{\"@id\":\"https:\/\/softwareengineeringdaily.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/software_daily\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/e890d5bb8941fc76fb69909e6702c34d\",\"name\":\"Gokhan Simsek\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9ad291f06753e23a47e536bcfe34701f?s=96&d=retro&r=pg\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9ad291f06753e23a47e536bcfe34701f?s=96&d=retro&r=pg\",\"caption\":\"Gokhan Simsek\"},\"description\":\"Gokhan is a computer science graduate, currently pursuing a MSc. degree in Data Science at Eindhoven University of Technology.\",\"sameAs\":[\"https:\/\/x.com\/GokhanSimseek\"],\"url\":\"https:\/\/softwareengineeringdaily.com\/author\/gokhan\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"LinkedIn Data Infrastructure - Software Engineering Daily","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/","og_locale":"en_US","og_type":"article","og_title":"LinkedIn Data Infrastructure - Software Engineering Daily","og_description":"LinkedIn has become a staple for the modern professional, whether it\u2019s used for searching for a new job, reading industry news, or keeping up with professional connections.\u00a0 As a rapidly growing platform that serves more than 675 million users today, LinkedIn is a company that can boast of having one of the largest user bases","og_url":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/","og_site_name":"Software Engineering Daily","article_published_time":"2020-02-18T16:00:10+00:00","article_modified_time":"2020-11-10T22:00:37+00:00","og_image":[{"width":2048,"height":1024,"url":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","type":"image\/jpeg"}],"author":"Gokhan Simsek","twitter_card":"summary_large_image","twitter_creator":"@GokhanSimseek","twitter_site":"@software_daily","twitter_misc":{"Written by":"Gokhan Simsek","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#article","isPartOf":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/"},"author":{"name":"Gokhan Simsek","@id":"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/e890d5bb8941fc76fb69909e6702c34d"},"headline":"LinkedIn Data Infrastructure","datePublished":"2020-02-18T16:00:10+00:00","dateModified":"2020-11-10T22:00:37+00:00","mainEntityOfPage":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/"},"wordCount":1793,"publisher":{"@id":"https:\/\/softwareengineeringdaily.com\/#organization"},"image":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","keywords":["data infrastructure","Deep Learning","Gobblin","Gokhan Simsek","Kapil Surlaker","LinkedIn","Machine Learning","Open Source"],"articleSection":["All Content","Exclusive Articles","Exclusive Content"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/","url":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/","name":"LinkedIn Data Infrastructure - Software Engineering Daily","isPartOf":{"@id":"https:\/\/softwareengineeringdaily.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage"},"image":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","datePublished":"2020-02-18T16:00:10+00:00","dateModified":"2020-11-10T22:00:37+00:00","breadcrumb":{"@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#primaryimage","url":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","contentUrl":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","width":2048,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/softwareengineeringdaily.com\/2020\/02\/18\/linkedin-data-infrastructure\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/softwareengineeringdaily.com\/"},{"@type":"ListItem","position":2,"name":"LinkedIn Data Infrastructure"}]},{"@type":"WebSite","@id":"https:\/\/softwareengineeringdaily.com\/#website","url":"https:\/\/softwareengineeringdaily.com\/","name":"Software Engineering Daily","description":"","publisher":{"@id":"https:\/\/softwareengineeringdaily.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/softwareengineeringdaily.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/softwareengineeringdaily.com\/#organization","name":"Software Engineering Daily","url":"https:\/\/softwareengineeringdaily.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/softwareengineeringdaily.com\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2024\/01\/cropped-sed_website_banner.png?fit=549%2C169&ssl=1","contentUrl":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2024\/01\/cropped-sed_website_banner.png?fit=549%2C169&ssl=1","width":549,"height":169,"caption":"Software Engineering Daily"},"image":{"@id":"https:\/\/softwareengineeringdaily.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/software_daily"]},{"@type":"Person","@id":"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/e890d5bb8941fc76fb69909e6702c34d","name":"Gokhan Simsek","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/softwareengineeringdaily.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9ad291f06753e23a47e536bcfe34701f?s=96&d=retro&r=pg","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ad291f06753e23a47e536bcfe34701f?s=96&d=retro&r=pg","caption":"Gokhan Simsek"},"description":"Gokhan is a computer science graduate, currently pursuing a MSc. degree in Data Science at Eindhoven University of Technology.","sameAs":["https:\/\/x.com\/GokhanSimseek"],"url":"https:\/\/softwareengineeringdaily.com\/author\/gokhan\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/softwareengineeringdaily.com\/wp-content\/uploads\/2020\/02\/LinkedIn.jpg?fit=2048%2C1024&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p7GuoD-2i9","_links":{"self":[{"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/posts\/8813"}],"collection":[{"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/comments?post=8813"}],"version-history":[{"count":0,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/posts\/8813\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/media\/10159"}],"wp:attachment":[{"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/media?parent=8813"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/categories?post=8813"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/softwareengineeringdaily.com\/wp-json\/wp\/v2\/tags?post=8813"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}