{"id":1032,"date":"2019-12-06T13:47:45","date_gmt":"2019-12-06T13:47:45","guid":{"rendered":"https:\/\/codesmartinc.com\/?p=1032"},"modified":"2020-06-03T14:31:35","modified_gmt":"2020-06-03T09:01:35","slug":"the-modern-data-platform","status":"publish","type":"post","link":"https:\/\/codesmartwebapp.azurewebsites.net\/?p=1032","title":{"rendered":"The Modern Data Platform"},"content":{"rendered":"\r\n<h2 class=\"has-text-align-center\"><em>Operationalizing <\/em>your Modern Data Estate<\/h2>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">At <a href=\"http:\/\/fyrsoft.com\">Fyrsoft<\/a> (sister company of CodeSmart), our Major Domo Approach involves creating a platform that enables strategic decision making based on <a href=\"https:\/\/codesmartinc.com\/data-intelligence\/\">data intelligence<\/a>. The only way to truly achieve strategic data intelligence is to take a comprehensive and holistic approach to data governance, accuracy, discoverability, security, and data science. The leader who leads this critical task, aka the Major Domo, stewards the data generated by the entire workforce and <em>ecosystem<\/em>. She must bring together the data streams from not only the segmented sources that drove traditional business intelligence over the last decade, but now integrate the data available from the entire inter-corporate ecosystem. This entails creating a comprehensive API focused strategy that takes all the data from the corporate data streams within the legacy digital systems and combining it with the data streams made available by customers, suppliers, competitors, and other critical components of the entire corporate ecosystem. To truly make data backed decisions, the Major Domo must add the critical metadata that gives insights into all levels of behavior and usage patterns from both inside and outside the company.\u00a0<\/p>\r\n\r\n\r\n\r\n<figure class=\"wp-block-image\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"555\" class=\"wp-image-1033\" src=\"https:\/\/codesmartinc.com\/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision-1024x555.png\" alt=\"\" srcset=\"\/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision-1024x555.png 1024w, \/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision-150x81.png 150w, \/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision-300x163.png 300w, \/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision-768x416.png 768w, \/wp-content\/uploads\/2019\/12\/The-Fyrsoft-Data-Strategy-Vision.png 1473w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">This approach ensures that there are data policies in place that enable the efforts of all the critical leaders that steer corporate strategy. \u00a0Segmented system owners are held accountable for the accuracy and timely availability of the data. Security and role-based control is centralized by the CISO\u2019s and Risk Officer\u2019s teams. The Chief Data Scientist\u2019s and CFO\u2019s office has the critical information to apply the data science and analytics necessary to deliver the KPIs critical to the transformation being driven by the CDO and CMO to deliver revenue growth. The core value: the senior management team must now leverage technology as a differentiator, and not just an enabler. The data will enable decisions that lead to innovation, formalize adherence to more granular, quantified, and detailed balance scorecards and competitive benchmarks.\u00a0 The data will guide decisions that affect all areas of corporate development, from mergers and acquisitions, to change management.<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">At Fyrsoft, our core approach to data is rooted in our history.\u00a0 We got our start in the HR data ecosystem from right here in Houston. Our distinguishing factor is the quality of our engineering. For us, this starts and ends with the quality of our engineers, i.e., our people.<\/p>\r\n\r\n\r\n\r\n<h2><strong>Fyrsoft Goal with Data &amp; AI and Microsoft: <\/strong><\/h2>\r\n\r\n\r\n\r\n<figure class=\"wp-block-image\"><img decoding=\"async\" width=\"1024\" height=\"346\" class=\"wp-image-1035\" src=\"https:\/\/codesmartinc.com\/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft-1024x346.png\" alt=\"Fyrsoft Goal with Data &amp; AI and Microsoft\" srcset=\"\/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft-1024x346.png 1024w, \/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft-150x51.png 150w, \/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft-300x101.png 300w, \/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft-768x259.png 768w, \/wp-content\/uploads\/2019\/12\/Fyrsoft-Goal-with-Data-AI-and-Microsoft.png 1069w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\r\n\r\n\r\n\r\n<figure class=\"wp-block-table aligncenter is-style-regular\">\r\n<table>\r\n<tbody>\r\n<tr>\r\n<td><strong>Successful Customer Engagements<\/strong><\/td>\r\n<td><strong>Strategic Solution Offerings<\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>\u2022\u00a0General Motors &#8211; Infotainment System Analytics<br \/>\u2022\u00a0Microsoft &#8211; Azure Utilization Insights<br \/>\u2022\u00a0AccuWeather \u2013 Azure Data Lake<br \/>\u2022\u00a0Expedia Recommendation System<br \/>\u2022\u00a0Bermuda Monetary Authority<br \/>\u2022Yukon State Investment Board<\/td>\r\n<td>\u2022 The Fyrsoft Data Platform<br \/>\u2022 Sales Enablement Analytics<br \/>\u2022 Weyerhaeuser \u2013 Solving Migration Problem to Azure SQL DW<br \/>\u2022 <a href=\"https:\/\/www.techopedia.com\/definition\/12829\/human-machine-interface-hmi\">Human Machine Interface<\/a> (HMI) Data Management &amp; Analytics<br \/>\u2022 Talent Data Management Analytics <br \/>\u2022 Intelligent Cloud Suite<br \/>\u2022 Azure-ML Powered Chat Bots<br \/>\u2022 SQL Server Migration to Azure DW Utilities<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/figure>\r\n\r\n\r\n\r\n<h2><strong>Customer Success Solution Map Aligned to the Microsoft Data and AI Solution Area:Intelligent Cloud:\u00a0 <\/strong><\/h2>\r\n<p class=\"wp-block-paragraph\"><br \/><strong>1. <\/strong><em><strong><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/hdinsight\/spark\/apache-spark-overview\">Azure Apache Spark<\/a> on HDInsight<\/strong><\/em><strong> \u2013<\/strong> Fyrsoft partnered with Microsoft\u2019s Azure Intelligence Platform team to design and develop an Apache Spark based solution that could handle Azure utilization data. The system processes over 32 Terabytes of new information daily along with the processing of over 2 Petabytes of historical data daily, is cloud-native and fully automated and is designed to be self-healing.\u00a0 The solution:<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">a. Reduced the time lag from 3 days to 4 hours for delivery of key uilization data to Microsoft\u2019s best Enterprise Customers<br \/>b. Delivered undiscovered customer usage patterns<br \/>c. Helped sales teams generate customized sales propositions to Enterprise Customers that utilize excess capacity with Azure regions worldwide<br \/>d. Generated recommendations to SMB customers including discount offers that take advantage of Azure utilization valleys<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\"><em><strong>2. Azure Data Lake<\/strong><\/em><strong> \u2013<\/strong> AccuWeather wanted to build a central data repository from multiple data sources (ex: Websites, Google Analytics, Google BigQuery, Ooyla Videos, Weather API) and present the data using PowerBI for dashboard reporting, automated reporting &amp; Data analytics<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">a. The Azure Data Lake Fyrsoft built is capable of bringing data from Batch, Near Real Time (NRT) and Real Time (RT) data sources<br \/>b. The Azure Data Lake for AccuWeather is designed and developed to store all structured and unstructured data in a single centralized data platform to allow Data Scientists to build AI models<br \/>c. Fyrsoft helped customer to define the scope by providing Discovery sessions and POC projects<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\"><strong>3. <\/strong><em><strong>Azure Data Factory + Azure Data Lake + Azure SQL DB + PowerBI<\/strong><\/em><strong> \u2013<\/strong> Yukon\u2019s State Investment Board\u2019s chose Fyrsoft to design and develop a cloud native solution that could handle a full stack Data and a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Business_intelligence\">Business Intelligence<\/a> solution. The new system replaced a full stack legacy LOB application. Fyrsoft is building a full stack solution on Azure that accomplishes the following:<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">a. A benchmark application for Investment Key stakeholders<br \/>b. Leveraging Azure Active Directory for secured authentication all SIB applications<br \/>c. Replacing a high-cost legacy application with a reliable solution built on Azure<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\"><strong>4. <\/strong><em><strong><a href=\"https:\/\/studio.azureml.net\/\">Azure ML Studio<\/a><\/strong><\/em><strong> \u2013 <\/strong>The Bermuda Monetary Authority receives thousands of documents, from financial institutions \u200boperating in the jurisdiction and assess risk for financial regulations of each institutions. Due to the shortage of time and continuous business engagements, this becomes impractical to go through them manually at a given time. The BMA needed a system that could read thousands of pages of annual business \/ financial documents and pull out key statistics that can be used to supervise the risk-based financial regulations that it applies to Bermuda\u2019s financial institutions.<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">a. Ran Azure ML Studio and Power BI on top of blob storage and Azure SQL<br \/>b. Extractive (Natural Language Processing) and Abstractive (Deep Learning) Techniques implemented on Texts and computer vision leveraging TensorFlow, Keras, and OpenCV in Azure.<br \/>c. Object detection framework, using state-of-the-art Image Processing methodologies, extracts the Images and Tables automatically<br \/>d. BMA\u2019s Risk Assessment effort is reduced by 85% from 2 days to 3 hours per institution<br \/>e. Efficiency of risk assessment increased by approximately 12% because of reduced manual errors<\/p>\r\n\r\n\r\n\r\n<h2><strong><br \/>About Author:<\/strong><\/h2>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">Faizeen Khandaker is a Managing Principal, Digital Strategy and Data Services for People Tech Group. He is ROI-driven technology leader with entrepreneurial expertise in the business strategy, execution, and revenue generation\u00a0required to innovate and implement disruptive solutions for corporations that require disruptive digital transformation.<\/p>\r\n\r\n\r\n\r\n<p class=\"wp-block-paragraph\">You can connect with him on\u00a0<a href=\"https:\/\/www.linkedin.com\/in\/faizeenkhandaker\/\">LinkedIn<\/a>.<\/p>\r\n","protected":false},"excerpt":{"rendered":"<p>At Fyrsoft (sister company of CodeSmart), our Major Domo Approach involves creating a platform that enables strategic decision making based on data intelligence.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[],"class_list":["post-1032","post","type-post","status-publish","format-standard","hentry","category-blogs","no-thumb"],"acf":[],"_links":{"self":[{"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/posts\/1032","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1032"}],"version-history":[{"count":12,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/posts\/1032\/revisions"}],"predecessor-version":[{"id":1409,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=\/wp\/v2\/posts\/1032\/revisions\/1409"}],"wp:attachment":[{"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1032"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1032"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/codesmartwebapp.azurewebsites.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1032"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}