Mainframe Sistemleri Ahmet Alper Tecimer 1 Garanti Teknoloji, Mainframe Platformları 11.03.2013 Ajanda Mainframe Nedir? 2 1
Mainframe Veri İşleme Topolojileri Centralized (Merkezi) Daha iyi performans, Güvenlik, Dışarıya daha az bağımlılık, Daha az bellek Availability(ulaşılabilirlik), Scalability(ölçeklenebilirlik) Decentralized (Merkezi olmayan) Availability, Scalability, Flexibility(esneklik) Yönetim, Enerji ve yer ihtiyacı, Network karmaşıklığı Distributed (Dağıtık) Availability, Scalability, Flexibility Veri bütünlüğü, Karmaşıklık, Yönetim, Enerji ve yer ihtiyacı 3 Mainframe Veri İşlemede İş Yükü Tipleri Commercial (Ticari) Basit fakat çok sayıda eşanlı transaction, yüklü batch işlem, I/O bağımlı Engineering & Scientific (Bilimsel) Çok fazla CPU bağımlı karmaşık işlemler, paralel işlenebilir büyük data Personal Computing (Kişisel) Tek kullanıcılı, oldukça basit 4 2
Mainframe A mainframe is a platform prone to the centralized topology, used concurrently by sometimes thousands of commercial users, each one with the perception of being alone in the system." 5 Mainframe - Tarihçe IBM Automatic Sequence Controlled Calculator (ASCC) 1944 Saniyede 3 toplama işlemi 6 Saniyede 1 çarpma işlemi IBM System/360-1964 Saniyede 33.000-750.000 toplama işlemi Bellek : 8.000-520.000 karakter İlk ticari bilgisayar sistemi 6 3
Mainframe - Tarihçe 64-bit FICON 7 Mainframe - Tarihçe 8 4
Mainframe - Tarihçe 9 Mainframe - Bugün IBM System zec12 2012 78.426 MIPS (120 işlemci 5.5 GHz) 3040 GB bellek 320 FICON kanal 10 5
zec12 Overview Machine Type 2827 5 Models H20, H43, H66, H89 and HA1 Processor Units (PUs) 27 (30 for HA1) PU cores per book Up to 16 SAPs per system, standard 2 spares designated per system Dependant on the H/W model - up to 20, 43, 66,89, 101 PU cores available for characterization Central Processors (CPs), Internal Coupling Facility (ICFs), Integrated Facility for Linux (IFLs), System z Application Assist Processors (zaaps), System z Integrated Information Processor (ziip), optional - additional System Assist Processors (SAPs) Sub-capacity available for up to 20 CPs 3 sub-capacity points Memory RAIM Memory design System Minimum of 32 GB Up to 768 GB per book Up to 3 TB for System and up to 1 TB per LPAR 32 GB Fixed HSA, standard 32/64/96/112/128/240/256 GB increments - Flash Express I/O 6 GBps I/O Interconnects carry forward only Up to 48 PCIe interconnects per System @ 8 GBps each Up to 4 Logical Channel Subsystems (LCSSs) Up to 3 Sub-channel sets per LCSS STP - optional (No ETR) zenterprise EC12 is the core of next generation System z Up to 25% Up to 50% Up to 101 Performance improvement over z196 uniprocessor 1 Total capacity improvement over z196 M80 1 Configurable cores for client use 60 subcapacity settings Up to 3 TB RAIM memory IFL, ziip, zaap, ICFs and optional SAPs Environmental focus to improve data center efficiencies including new non raised floor option Upgradeable from IBM zenterprise 196 (z196) and System z10 Enterprise Class (z10 EC ) zec12 Machine Type: 2827 Models: H20, H43, H66, H89, HA1 Advanced Technology 5.5 GHz processor chip for performance boost for all workloads Over 78,000 MIPS for large scale consolidation Larger cache for data serving Processor chip optimized for software performance Advanced performance functions exploited by Java, PL/I, compilers, DB2 and more Innovation to drive availability to superior levels IBM zaware with out-of-band analytics provide point in time snapshot of the current state of your business and can help you improve availability FLASH Express and pageable large pages to drive availability and performance for critical workloads Security and reliability are in our DNA High speed cryptography integrated as part of the chip Enhanced support for applications requiring data encryption, cryptographic keys and digital signing with new Crypto Express4S PR/SM designed for EAL5+ certification 1Based on preliminary internal measurements and projections. Official performance data will be available upon announce and can be obtained online at LSPR (Large Systems Performance Reference) website at: https://www-304.ibm.com/servers/resourcelink/lib03060.nsf/pages/lsprindex?opendocument. Actual performance results may vary by customer based on individual workload, configuration and software levels. 6
IBM zaware IBM System z Advanced Workload Analysis Reporter Monitors z/os OPERLOG messages including all z/os console message, ISV and application generated messages Can monitor across a sysplex Samples every 2 minutes. Reports on 10 minute time slices. Uses a 90 day baseline created from SYSLOG Detects anomalies monitoring systems miss: Messages may be suppressed or rare Messages may indicate a trend Reports on unique messages, and a score Color-coded, browser-based (IE 8, Firefox) XML Output consumable through published API, can drive ISV products Expert Knowledge Integrated IBM zaware Machine Learning Intuitive Bir karşılaştırma.. Meral Temel e teşekkürler 14 7
Mainframe CPU What is it look like? Mainframe CPC Book ( z10 Model sample) 15 Mainframe - Bugün 16 8
Mainframe - Bugün 17 Mainframe - Bugün Dünyadaki datanın %80 i Aynı anda 900.000 process 40 km mesafeden I/O cihazları MF için yazılım üreten 1300 den fazla şirket İşletim sistemi z/os; En temel hali 15 GB Kurulumu min. 1 ay Tek seferde satın alınmaz, kullandıkça ödenir. Mainframe Kullanan Şirketler: 18 9
Ajanda Bazı Kavramlar? 19 Bazı kavramlar Cache MIPS (Million Instruction per Second) Cycle CISC (Complex Instruction Set Computin) 20 10
Ajanda Neden Mainframe? 21 Neden Mainframe? 22 11
Availability Şirketlerin Availability e Göre Dağılımları Sektör Saatlik kesinti maliyeti ($) Borsa Aracı Kurumları 6.5 milyon Kredi Kartı Otorizasyon 2.6 milyon Havayolu Rezervasyon 90.000 23 Ajanda Parallel Sysplex z/os Workload Management Data Disaster Recovery / Business Continuity Hints & Tips 24 12
Ajanda Mainframe de kullanılan teknolojiler Parallel Sysplex 25 Parallel Sysplex (SYStems complex) Parallel Sysplex Evolution Single system uniprocessor Tightly coupled multiprocessors Loosely coupled configuration Base sysplex Parallel sysplex (CF) 26 13
Parallel Sysplex 27 Parallel Sysplex 28 14
Coupling Facility A coupling facility is a special logical partition that runs the CFCC and provides high speed caching, list processing and locking functions in a sysplex. Lock structure List structure Cache structure 29 Ajanda Parallel Sysplex z/os Workload Management Data Disaster Recovery / Business Continuity Hints & Tips 30 15
Mainframe operating systems z/os z/vm VSE Linux for zseries z/tpf z/os 32 16
z/os -1964 ten bugüne 33 z/os - Storage Central Storage Mainframe işlemcilerinde yer alır Senkron erişim Virtual Storage Auxiliary Storage Mainframe in dışında yer alır Asenkron erişim 34 17
What is z/os? The most widely used mainframe operating system 64-bit operating system Ideally suited for processing large workloads for many concurrent users Designed for: Serving 1000s of users concurrently I/O intensive computing Processing very large workloads Running mission critical applications securely Program products for z/os A z/os system usually contains additional program products (priced software) that are needed to create a practical working system: security manager (TSS) database manager (DB2) compilers (Ent. PL/I, Ent. Cobol) utility programs (SDSF, Terse) vendor products (Beta 92, FileAID, Strobe) 18
A brief comparison of z/os and UNIX Quite a few concepts are common to both: Boot the system versus IPL the system Files versus data sets Editors vi, ed, sed, and emacs (UNIX) versus ISPF (z/os) telnet or rlogin (UNIX) versus TSO logon (z/os) Virtual Storage Virtual storage means that each running program can assume it has access to all of the storage defined by the architecture s addressing scheme. The only limit is the number of bits in a storage address. 38 19
Address Space Kavramı The address space is a set of contiguous virtual addresses available to a program instructions and its data. 39 Ajanda Workload Management 40 20
Workload Manager (WLM) Her 10 sn de bir ölçümle, Her 20 sn de bir müdahele et. 41 Workload Manager (WLM) Service Classes Importance Performance Goal Response Time Velocity Discretionary 42 21
Ajanda Data 43 What is a data set? A data set is a collection of logically related data records stored on one disk storage volume or a set of volumes. A data set can be: a source program a library of macros a file of data records used by a processing program. You can print a data set or display it on a terminal. The logical record is the basic unit of information used by a program running on z/os. 22
Data Set Sequential Data Sets En basit veri yapısı Kayıtlar fiziksel olarak birbiri ardına kaydedilir. Partitioned Data Sets (PDS) Member adı verilen sequential data set ler grubudur. Her member ın bulunduğu yeri gösteren pointer lar içeren bir directory si vardır. VSAM KSDS Key Sequenced Data Set ESDS Entry Sequenced Data Set RRDS Relative Record Data Set LDS Linear Data Set 45 Data Set Data Set İsimlendirme Standartları THIS.IS.A.VALID.DATASET.NAME DATASET.QUALIFIERS.CANNOT.BE.LONGER.THAN8 DATASET.NAMES.CAN.CONTAIN.NUMB3RS BUT.NOT.1AT.2THE.3START.4OF.SEGMENTS DATASET.NAMES.CAN.BE44.CHR.LONG 46 23
DASD: Use and terminology Direct Access Storage Device (DASD) is another name for a disk drive. DASD volumes are used for storing data and executable programs. Data sets in a z/os system are organized on DASD volumes. A disk drive contains cylinders Cylinders contain tracks Tracks contain data records. Catalogs and VTOCs z/os uses a catalog and a volume table of contents (VTOC) on each DASD volume to manage the storage and placement of data sets. VTOC: Lists the data sets on a volume Lists the free space on the volume. 24
VTOC LABEL (volser) VTOC MY.DATA YOUR.DATA free space tracks tracks tracks Extents z/os UNIX file systems z/os UNIX System Services (z/os UNIX) allows z/os to access UNIX files. A z/os UNIX file system is hierarchical and byte-oriented. Files in the UNIX file system are sequential files and are accessed as byte streams. UNIX files and traditional z/os data sets can reside on the same DASD volume. 25
UNIX file system structure -zfs Directory Directory Directory Directory Directory Directory File File File File File File File File File File File File File File File Ajanda Disaster Recovery / Business Continuity 52 26
Disaster Recovery / Business Continuity Recovery Point Objective (RPO) Recovery Time Objective (RTO) Mesafe / Lokasyon 53 Disaster Recovery / Business Continuity Pickup Truck Access Method (Tape backup & restore) RPO > 24 saat RTO ~ 48 saat Mesafe önemsiz 54 27
Disaster Recovery / Business Continuity Synchronous Disk Mirroring (Metro mirror PPRC) RPO = 0 RTO ~ 0-2 saat Mesafe 0-100 km 55 Disaster Recovery / Business Continuity Asynchronous Disk Mirroring (z/os Global Mirror XRC) RPO ~ 3-5 saniye RTO ~ 2-3 saat Mesafe limitsiz 56 28
GDPS Geographically Dispersed Parallel Sysplex 57 Comparison of Utilization Rate «All computers wait at the same speed!!!» 29
System z Shared Everything Hangisi daha iyi? Maserati MC12 Peterbilt 389 620 beygir gücü 330 km/s max hız. 600.000 600 beygir gücü 225 km/s max hız. 150.000 $ 30
Yarışın kurallarını koyalım (1) Maserati MC12 Peterbilt 389 Mesafe: 250 metre Yük: Sürücü Kim kazanır??? Yarışın kurallarını koyalım (2) Maserati MC12 Peterbilt 389 Mesafe: 10 km Yük: Sürücü + 10 ton Kim kazanır??? 31
Yarışın kurallarını koyalım (3) 10 * Maserati MC12 Peterbilt 389 Mesafe: 10 km Yük: Sürücü + 10 ton Kim kazanır??? Yarışın kurallarını koyalım (4) 10 * Ford 1 ton Pickup Peterbilt 389 Mesafe: 10 km Yük: Sürücü + 10 ton Kim kazanır??? 32
Hızı analiz etmekten daha fazlası Yük ne? Parçalara bölünebilir mi? 1 tır yerine 10 pickup ile taşınabilir mi? Tır yükün götürüleceği yollara sığabilir mi? 10 sürücü mü? 1 sürücü mü? (çalışan insan gücü) Yakıt maliyeti farkları (enerji) Bakım/servis masrafları Yükleme / Boşaltma masrafları (uygulama geliştirme, kurulum, işletim sistemi) 65 Mainframes combine three important features: 1) Reliable performance, which is essential for reasonable operations against a database. 2) Maximum I/O connectivity, which means mainframes excel at providing for huge disk farms. 3) Maximum I/O bandwidth, so connections between drives and processors have few choke-points. 66 33
Ajanda Workload Tipleri 67 Typical mainframe workloads Application Program Batch job Input Data Process data to perform a particular task Output Data Online (real time) transaction Query Reply Application Program Access shared data on behalf of online user 34
XX/XX/XX XX/XX/XX PAUL FISCHER 3/14/2013 Typical batch use CREDIT CARD 1234 5678 9012 VALID FR OM GO OD THR U Processing reports 7 Residence Account balances bills, etc 6 Branch offices 5 Reports 4 Main office Statistics, summaries, exceptions Partners and clients exchange information 8 Mainframe Processing batch jobs 2 Reports 1 Reports Backups 3 9 Data update 10 Tape Storage Sequential data sets Production Control System Operator Disk Storage databases Typical online use ATMs Account activities 1 SNA or TCP/IP network 4 Requests Branch offices Branch office automation systems 2 Office automation systems 53995324460 3 Mainframe Accesses database 5 Central office queries and updates 6 Business analysts Inventory control Disk storage controller Stores database files 35
Roles in the mainframe world Roles Application Developer Production Control Analyst End User Operator System Programmer System Administrator Ajanda İpuçları 72 36
CAP KAVRAMI YOĞUN GÜNLER KAYNAK PAYLAŞIMI 20 CP aynı anda 20 işlem demek, fazlası queue da bekler önceliklere göre Batch JOB OUTPUT Anlamları Herşey Performams 1 - İşin çalıştığı sistem adı 2 - İş başlarken atanan service class 3 - İş içerisindeki user code un CPU üzerinde aktif olarak geçirdiği zaman 4 - İş tarafınan çağırılan sistem servislerinin CPU üzerinde geçirdiği zaman 5 - Steplerin ve işin sisteme aktif olduğu zaman 6 - İş içerisine yapılan I/O çağrısı sayısı ( yapılan I/O miktarı) 37
Access To Mainframe 75 Teşekkürler.. Dinlediğiniz için teşekkürler 76 38