TY - GEN
T1 - A Novel Spatio-Temporal Data Storage and Index Method for ARM-Based Hadoop Server
AU - Han, Laipeng
AU - Huang, Lan
AU - Yang, Xueyi
AU - Pang, Wei
AU - Wang, Kangping
N1 - This project is supported by Science and Technology Development Plan of Jilin Province (20140204010SF) and Chinese National Natural Science Foundation (61472159). WP is supported by the PECE bursary from The Scottish Informatics and Computer Science Alliance (SICSA).
PY - 2016
Y1 - 2016
N2 - During the past decade, a vast number of GPS devices have produced massive amounts of data containing both time and spatial information. This poses a great challenge for traditional spatial databases. With the development of distributed cloud computing, many highperformance cloud platforms have been built, which can be used to process such spatio-temporal data. In this research, to store and process data in an effective and green way, we propose the following solutions: firstly, we build a Hadoop cloud computing platform using Cubieboards2, an ARM development board with A20 processors; secondly, we design two types of indexes for different types of spatio-temporal data at the HDFS level. We use a specific partitioning strategy to divide data in order to ensure load balancing and efficient range query. To improve the efficiencyof disk utilisation and network transmission, we also optimise the storage structure. The experimental results show that our cloud platform is highly scalable, and the two types of indexes are effective for spatio-temporal data storage optimisation and they can help achieve high retrieval efficiency.
AB - During the past decade, a vast number of GPS devices have produced massive amounts of data containing both time and spatial information. This poses a great challenge for traditional spatial databases. With the development of distributed cloud computing, many highperformance cloud platforms have been built, which can be used to process such spatio-temporal data. In this research, to store and process data in an effective and green way, we propose the following solutions: firstly, we build a Hadoop cloud computing platform using Cubieboards2, an ARM development board with A20 processors; secondly, we design two types of indexes for different types of spatio-temporal data at the HDFS level. We use a specific partitioning strategy to divide data in order to ensure load balancing and efficient range query. To improve the efficiencyof disk utilisation and network transmission, we also optimise the storage structure. The experimental results show that our cloud platform is highly scalable, and the two types of indexes are effective for spatio-temporal data storage optimisation and they can help achieve high retrieval efficiency.
U2 - 10.1007/978-3-319-48671-0_19
DO - 10.1007/978-3-319-48671-0_19
M3 - Conference contribution
SN - 978-3-319-48670-3
T3 - Lecture Notes in Computer Science
SP - 206
EP - 216
BT - ICCCS 2016: Cloud Computing and Security
A2 - Sun, Xingming
A2 - Liu, Alex
A2 - Chao, Han-Chieh
A2 - Bertino, Elisa
PB - Springer
T2 - 2nd International Conference on Cloud Computing and Security 2016
Y2 - 29 July 2016 through 31 July 2016
ER -