Gürsel Kaynak. Senior Specialist Systems Engineer EMC Corporation

Transkript

1

2 Gürsel Kaynak Senior Specialist Systems Engineer EMC Corporation

3 Disruptive / Opportunistic IT Trends Mobile Cloud Big Data Social T R U S T

4 BILLIONS OF USERS MILLIONS OF APPS Mobile Cloud Big Data Social Mobile Devices HUNDREDS OF MILLIONS OF USERS TENS OF THOUSANDS OF APPS LAN/Internet PC Client/Server MILLIONS OF USERS THOUSANDS OF APPS Source: IDC, 2013 Mainframe, Mini Computer Terminals

5 ADVANCED SECURITY : A Unique Federation Of Businesses Focused & Free To Execute On Their Mission, Strategically Aligned PLATFORM FOR CLOUD, BIG/FAST DATA APPS SOFTWARE-DEFINED DATA CENTER INFORMATION INFRASTRUCTURE

6 Our Dual Innovation Strategy Research & Development 12% Investment Technology Acquisitions String Of Pearls 10% Investment

7 The Business Drivers Increase Revenue Lower Operational Costs Reduce Risk

8 Cloud Transforms IT Infrastructure 1 Standardize 2 Virtualize 3 Automate

9 Two Distinct Architectures Next Gen Cloud Applications Traditional Applications M SIMPLE DATA SERVICES M 700% M M 70% ADVANCED DATA SERVICES HDFS / Object Storage Eventual Consistency Software-Based Resiliency Block / File Storage Transactional Consistency Hardware-Based Resiliency

10 Location & Types Of Big Data Enterprise Partner Public Unstructured Data Credit Data Shipping Data Structured Data Forecast Data Location Data Social, Video Data

11 Location & Types Of Big Data (& Fast!) Data Enterprise Partner Public Unstructured Data Credit Data Shipping Data Structured Data Telemetry Data Forecast Data Location Data Social, Video Data

12 The Value Of Data Is Also Growing New Business Models Are Based On Data! 1,000,000,000 Queries / Day 250,000,000 New Photos / Day 290,000,000 Updates / Day 4,000,000 Claims / Day 2,800,000,000 Trades / Day 31,000,000,000 Interactions / Day

13 New Apps Are Built In New Ways Social & Primarily Accessed By Mobile Devices Developed With Modern Programming Tools & Data Fabrics Deployed On A Software-Defined Cloud Infrastructure Public Cloud

14

15 Introducing Pivotal PLATFORM FOR NEXT GENERATION CLOUD & BIG / FAST DATA APPLICATIONS 1250 EMPLOYEES ~$300M IN 2013 REVENUE

16 Open Architecture Provides Choice Private, Virtual Private & Public Cloud Deployment Options Next Generation Cloud & Big / Fast Data Apps Private Cloud Virtual Private Cloud Public Cloud

17 How Can Big Data Transform Your Business? New Source of Customer, Product and Operational Insights Today s Decision-making Big Data Decision-making Rearview Mirror hindsight Less than 10% of available data Incomplete, disjointed, inaccurate Forward-looking insight Exploit all data from diverse sources Real-time, correlated

18 Leveraging Full Power of the Family

19 Hadoop Adoption in the Industry The Datagraph Blog Source: Hadoop Summit Presentations

20 Target Markets, Verticals & Pain Hadoop Use Cases by Vertical Finance Web 2.0 Telecom Healthcare Risk Modeling/Management Portfolio Analysis Investment Predictions Fraud Detection Compliance Check Customer Profiling Social Media Analytics ETL Network analysis based on transactions Product Recommendation Engine Search Engine Indexing (Search Assist) Content Optimization Advertising Optimization Customer Churn Analysis POS Transaction Analysis Data Warehousing Network Graph Analysis Call Detail Record (CDR) Analysis Network Optimization Service Optimization & Log Processing User Behavior Analysis Customer Churn Prediction Machine-generated data centralization (logs from firewalls, towers, switches, servers, etc..) Electronic Medical Record Analysis Claims Fraud Detection Drug Safety Analysis Personalize Medicine Healthcare Service Optimization Drug Development Healthcare Information Exchange Medical Image Processing

21 HOW DO WE SPEED DEPLOYMENT

22 Three Paths To Cloud Infrastructure EMC Products Partner VSPEX VCE VBLOCK Best Of Breed Infrastructure Components Proven Infrastructure Converged Infrastructure Simpler, Faster, Lower TCO

23 EMC VSPEX SIMPLE. EFFICIENT. FLEXIBLE. PROVEN. BY EMC.

24 OVER 1500 PARTNERS

25 CUSTOMERS VSPEX: More Customers In Half The Time Customers In 40+ Countries NetApp Source: EMC And NetApp Earnings Announcements MONTHS SINCE FLEXPOD LAUNCH

26 HOW DO WE MANAGE BOTH ARCHITECTURES

27 EMC ISILON BIG DATA STORAGE

28 Scale Capacity EMC CONFIDENTIAL INTERNAL USE ONLY 38 Geleneksel Scale-Up Darboğazlar... Isilon Scale-Out Eşzamanlılığın gücü Controller Disk Shelves Kontrolcüler & diskler Master / Slave sistemler yada 2-yollu clusterlar Bir çok dosya sistemi / Volumelar Bir çok yönetim N-Storage noktası Adacıkları ENTERPRISE CLASS ISILON IQ NODES CPU, Cache, I/O, Disks (optional 2 nd switch) (Intra-cluster Infiniband) 144 Node a kadar, 10TB dan 20PB a Tekil Peer-to-Peer Cluster OneFS Dağıtık Dosya Sistemi Tek bir Storage Pool/Namespace Tek Noktadan N-Yollu Yönetim Simetrik Cluster

29 EMC CONFIDENTIAL INTERNAL USE ONLY 39 EMC Isilon Çekirdek İnovasyonu OneFS Scale-Out Operating System

30 Geleneksel Name Node Mimarisi Name Node Namenode un otomatik olarak tamiri mümkün değildir. İleride Hadoop mimarisine failover gelse bile, manual olarak recovery gerekir. When Name Node Namenode map is verinin lost nerede or damaged, saklandığının data bilgisine location information sahiptir no longer exists

31 Isilon HDFS Arayüzü Isilon Namenode ve Datanode arayüzlerini kendi üstünde destekler. Dosya Sistemi olarak OneFs kullanılır. Sadece HDFS istemcilerine Isilon un ismini yazmanız ile çalışır!

32 HDFS bir protokoldür! Isilon nodeları ( den itibaren) Namenode ve datanode protokollerini konuşabiliyor. Böylelikle bu iki servis için ayrı bir sunucu ve depolama cihazı yatırımı yapılmasına gerek yok! Cluster içindeki her Isilon node u hem namenode hem de datanode olarak çalışıyor (isi_hdfs_d) Veri aynı NFS yada SMB de olduğu gibi tüm OneFS dosya sistemine eşit olarak yayılıyor.

33 Clustered NameNode Isilon ile Dağıtık (Clustered) Name Node yapısı Name Node MTTDL = 5,000 yıl Metadata tüm node lar üzerine yayılıyor. Tüm node lar arasında kesintisiz ve sağlıklı bir yapı vardır. Isilon ile hem verileriniz, hem de HDFS sisteminizin verileri emanet altında

34 Snapshot/Versiyon Kontrol 5 5 Öncesi Geleneksel HDFS de replikasyon yoktur Verilerin snapshot ı alınamaz Versiyon kontrolü yoktur İş sürekliliği mümkün değildir. Sonrası HDFS e snapshot özelliği gelir. Multi-threaded li, Çoklu- Node Scale-Out replikasyon RPO/RTO zamanı belli Geo-replikasyonlu Hadoop!

35 İşlem gücü Isilon ile büyüme Yüksek performans ve kapasite! Hadoop Depolama İşlem gücü hızı sabit İşlemci gücünü arttırırken kapasite de arttırılır. QoS belirlemek zordur İşlem gücü güncellemesi için tüm sistem değişmek zorunda! depolama Isilon Depolama kısmına bağlı kalmadan işlemci gücünü arttırmak mümkün. İşyüküne göre performans almak mümkün. Depolama sistemi değişmeyeceği için veri taşımasına gerek yok. İstenildiği gibi donanım arttırmak mümkün.

36 Protokol Desteği Sunucular Sunucular Sunucular Sunucular Sunucular Öncesi HDFS, Windows, Unix, Linux, Apple, yada başka işletim sistemlerine görünür değildir. Big Data sadece Big Data için kullanılır. Sonrası Çoklu Protokol desteği ile tüm protokollerden erişim mümkündür.! Big Data gerçek verinizdir ve sizindir!

37 EMC VIPR

38 EMC ViPR, Software-Defined Storage ViPR Data Services: The Architecture For Next Gen Cloud Apps EMC ViPR Platform ViPR Data Services ViPR Controller Provisioning Self-Service Reporting Automation VMAX VNX Isilon 3 rd Party Commodity

39 ViPR Future Direction More ViPR Data Services & Support For Commodity Hardware EMC ViPR Platform ViPR Data Services ViPR Controller Provisioning Self-Service Reporting Automation VMAX VNX Isilon 3 rd Party Commodity

40 Why Is This So Transformative? RUN CLOUD APPS UNCHANGED Atmos Isilon 3 rd Party VNX USE EXISTING ARRAYS FOR OBJECT LEVERAGE COMMODITY HARDWARE

41 Trusted IT Means Identifying & Repelling Threats Advanced Security Protecting Data Integrated Backup & Recovery Ensuring Availability Of Applications, Systems & Data Continuous Availability

42 Adaptive & Risk-Based Authentication User Action Analysis Engine Private Cloud Read Username & Password Download Sales Pipeline Additional Authentication Two-Factor Device Profile User Behavior Profile Fraud Network Public Cloud Access Bank Account Username & Password Out Of Band Transfer Funds Challenge Q Additional Authentication

43 Centralize Data Protection Storage Data Domain Is Protection Storage ViPR Data Services ViPR Controller Data Domain VMAX VNX Isilon 3 rd Party Commodity

44 Continuous Availability VPLEX & RecoverPoint Become Advanced Data Services ViPR Data Services ViPR Controller Data Domain VMAX VNX Isilon 3 rd Party Commodity

45 A Closer Look At The Public Cloud.

46 HOW DO WE PROVIDE SIMPLE WEB SCALE STORAGE FOR BOTH ARCHITECTURES

47 PROJECT NILE ELASTIC CLOUD STORAGE FOR YOUR PRIVATE CLOUD OR YOUR ONLINE SERVICE

48 PROJECT NILE THE WORLDS FIRST COMMERCIALLY AVAILABLE COMPLETE WEB-SCALE STORAGE I N F R A S T R U C T U R E F O R Y O U R D ATA C E N T E R Block File Object COMPLETE Elastic Self-Service Exabyte+ WEB-SCALE Service Provider Enterprise ANY DATA CENTER

49 ADVANCED SECURITY Has Built A Differentiated Stack Best Of Breed. Architected Horizontally, Not Vertically. Choice. PLATFORM FOR CLOUD, BIG/FAST DATA APPS SOFTWARE-DEFINED DATA CENTER INFORMATION INFRASTRUCTURE

50 Sorularınız?