| 1. Identity statement | ||||
| Reference Type | Book Section | |||
| Site | mtc-m21b.sid.inpe.br | |||
| Holder Code | isadg {BR SPINPE} ibi 8JMKD3MGPCW/3DT298S | |||
| Identifier | 8JMKD3MGP3W34P/3LKJ8DB | |||
| Repository | sid.inpe.br/mtc-m21b/2016/05.03.15.42 (restricted access) | |||
| Last Update | 2017:01.02.16.15.59 (UTC) administrator | |||
| Metadata Repository | sid.inpe.br/mtc-m21b/2016/05.03.15.42.50 | |||
| Metadata Last Update | 2021:01.03.02.53.34 (UTC) administrator | |||
| Secondary Key | INPE--/ | |||
| DOI | 10.1007/978-3-319-32467-8_64 | |||
| ISBN | 978-331932466-1 | |||
| Citation Key | RamosTaAlAcCuDi:2016:DiSyPe | |||
| Title | Distributed systems performance for big data  | |||
| Year | 2016 | |||
| Access Date | 2024, Apr. 18 | |||
| Secondary Type | PRE LI | |||
| Number of Files | 1 | |||
| Size | 1136 KiB | |||
| 2. Context | ||||
| Author | 1 Ramos, Marcelo Paiva 2 Tasinaffo, Paulo Marcelo 3 Almeida, Eugênio Sper de 4 Achite, Luis Marcelo 5 Cunha, Adilson Marques da 6 Dias, Luiz Alberto Vieira | |||
| Resume Identifier | 1 2 3 8JMKD3MGP5W/3C9JH2S 4 5 6 8JMKD3MGP5W/3C9JHML | |||
| Group | 1 SSS-CPT-INPE-MCTI-GOV-BR 2 3 SSS-CPT-INPE-MCTI-GOV-BR | |||
| Affiliation | 1 Instituto Nacional de Pesquisas Espaciais (INPE) 2 Instituto Tecnológico de Aeronáutica (ITA) 3 Instituto Nacional de Pesquisas Espaciais (INPE) 4 Instituto Tecnológico de Aeronáutica (ITA) 5 Instituto Tecnológico de Aeronáutica (ITA) 6 Instituto Tecnológico de Aeronáutica (ITA) | |||
| Author e-Mail Address | 1 marcelopaivaramos@gmail.com 2 3 eugenio.almeida@inpe.br | |||
| Editor | Lafiti, Shahram | |||
| Series Editor | Kacprzyk, Janusz | |||
| Book Title | Information technology: new generations | |||
| Publisher | Springer Verlag | |||
| Volume | 448 | |||
| Pages | 733-744 | |||
| Series Title | Advances in Intelligent Systems and Computing | |||
| History (UTC) | 2016-05-03 15:45:52 :: simone -> administrator :: 2016 2016-07-04 12:30:00 :: administrator -> simone :: 2016 2016-12-21 13:15:34 :: simone -> administrator :: 2016 2021-01-03 02:53:34 :: administrator -> simone :: 2016 | |||
| 3. Content and structure | ||||
| Is the master or a copy? | is the master | |||
| Content Stage | completed | |||
| Transferable | 1 | |||
| Content Type | External Contribution | |||
| Version Type | publisher | |||
| Keywords | Big data Climate prediction Cluster HPC Distributed systems Hadoop Hive Python | |||
| Abstract | This paper describes a methodology for working with distributed systems, and achieve performance in Big Data, through the framework Hadoop, Python programming language, and Apache Hive module. The efficiency of the proposed methodology is tested through a case study that addresses a real problem found in the supercomputing environment of the Center for Weather Forecasting and Climate Studies linked to the Brazilian Institute for Space Research (CPTEC/INPE), which provides Society a work able to predict disasters and save people lives. In all three experiments involving the issue, using the Cray XT-6 supercomputer: (i) the first issue involves programming in Python and a sequential and monoprocessed arquitecture; (ii) the second uses Python and Hadoop framework, over parallel and distributed arquitecture; (iii) the latter combines Hadoop and Hive in a parallel and distributed arquitecture. The main results of these experiments are compared, discussed, and topics beyond the scope in this research are exposed as recommendations and suggestions for future work. | |||
| Area | MET | |||
| Arrangement | urlib.net > BDMCI > Fonds > Produção anterior à 2021 > SESSS > Distributed systems performance... | |||
| doc Directory Content | access | |||
| source Directory Content | there are no files | |||
| agreement Directory Content |
| |||
| 4. Conditions of access and use | ||||
| Language | en | |||
| Target File | ITNG1_DistributedSystemsPerformanceForBigData.pdf | |||
| User Group | self-uploading-INPE-MCTI-GOV-BR simone | |||
| Visibility | shown | |||
| Read Permission | deny from all and allow from 150.163 | |||
| Update Permission | not transferred | |||
| 5. Allied materials | ||||
| Mirror Repository | urlib.net/www/2011/03.29.20.55 | |||
| Next Higher Units | 8JMKD3MGPCW/43SRFME | |||
| Dissemination | BNDEPOSITOLEGAL | |||
| Host Collection | sid.inpe.br/mtc-m21b/2013/09.26.14.25.20 | |||
| 6. Notes | ||||
| Empty Fields | archivingpolicy archivist callnumber city copyholder copyright creatorhistory descriptionlevel e-mailaddress edition format issn label lineage mark nextedition notes numberofvolumes orcid parameterlist parentrepositories previousedition previouslowerunit progress project readergroup rightsholder schedulinginformation secondarydate secondarymark session shorttitle sponsor subject tertiarymark tertiarytype translator url | |||
| 7. Description control | ||||
| e-Mail (login) | simone | |||
| update | ||||