Stream operators for querying data streams

Lisha Ma, Stratis D. Viglas, Meng Li, Qian Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

One of the most important uses of aggregate queries over data streams is sampling. Typically, aggregation is performed over sliding windows where queries return new results whenever the window contents change, a concept referred to as a continuous query. Existing data models and query languages for streams are not capable of expressing many practical user-defined samplings over streams. To this end we propose a new data stream model, referred to as the sequence model, and a query language for specifying aggregate queries over data streams. We show that the sequence model can readily express a superset of the aggregate queries expressible in the previously proposed time-based data stream model, thus providing a declarative and formal semantics to understand and reason about continuous aggregate queries. Defined on top of the sequence model, our query language supports existing sliding window operators and a novel frequency operator. By using the frequency operator one is capable of expressing useful sampling queries, such as queries with user-defined group-based sampling and nested aggregation over either the input stream or the result stream. Such capabilities are beyond those of previously proposed query languages over streams. Finally, we conduct a preliminary experimental study that shows our language is effective and efficient in practice. © Springer-Verlag Berlin Heidelberg 2005.

Original languageEnglish
Title of host publicationAdvances in Web-Age Information Management - 6th International Conference, WAIM 2005, Proceedings
Pages404-415
Number of pages12
Volume3739 LNCS
DOIs
Publication statusPublished - 2005
Event6th International Conference on Advances in Web-Age Information Management - Hangzhou, China
Duration: 11 Oct 200513 Oct 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3739 LNCS
ISSN (Print)0302-9743

Conference

Conference6th International Conference on Advances in Web-Age Information Management
Abbreviated titleWAIM 2005
CountryChina
CityHangzhou
Period11/10/0513/10/05

Fingerprint Dive into the research topics of 'Stream operators for querying data streams'. Together they form a unique fingerprint.

  • Cite this

    Ma, L., Viglas, S. D., Li, M., & Li, Q. (2005). Stream operators for querying data streams. In Advances in Web-Age Information Management - 6th International Conference, WAIM 2005, Proceedings (Vol. 3739 LNCS, pp. 404-415). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3739 LNCS). https://doi.org/10.1007/11563952_36