Automotive Stream Based Data Management
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Computer Science Clay
Active In SP

Posts: 712
Joined: Jan 2009
07-08-2009, 05:29 PM

An embedded system is a special-purpose system in which the computer is completely encapsulated by the device it controls. Unlike a general-purpose computer, such as a personal computer, an embedded system performs one or a few pre-defined tasks, usually with very specific requirements. Since the system is dedicated to specific tasks, design engineers can optimize it, reducing the size and cost of the product.

Use Search at wisely To Get Information About Project Topic and Seminar ideas with report/source code along pdf and ppt presenaion
seminar class
Active In SP

Posts: 5,361
Joined: Feb 2011
04-04-2011, 02:08 PM

.ppt   week14.ppt (Size: 560.5 KB / Downloads: 56)
Stream-based Data Management
Characteristics of Data Streams

 Data Streams
 Data streams—continuous, ordered, changing, fast, huge amount
 Traditional DBMS—data stored in finite, persistent data sets
 Characteristics
 Huge volumes of continuous data, possibly infinite
 Fast changing and requires fast, real-time response
 Data stream captures nicely our data processing needs of today
 Random access is expensive—single linear scan algorithm (can only have one look)
 Store only the summary of the data seen thus far
 Most stream data are at pretty low-level or multi-dimensional in nature, needs multi-level and multi-dimensional processing
Stream Data Applications
 Telecommunication calling records
 Business: credit card transaction flows
 Network monitoring and traffic engineering
 Financial market: stock exchange
 Engineering & industrial processes: power supply & manufacturing
 Sensor, monitoring & surveillance: video streams
Security monitoring
 Web logs and Web page click streams
 Massive data sets (even saved but random access is too expensive)
 Data Streams vs. Data Sets
Data Sets: Data Streams:
 Updates infrequent
 Using Traditional Database
 Data Streams Paradigm
 Data Streams Paradigm
 DBMS versus DSMS
• Persistent relations
• Transient streams (and persistent relations)
 DBMS versus DSMS
• Persistent relations
• Transient streams (and persistent relations)
 DBMS versus DSMS
• Persistent relations
• Transient streams (and persistent relations)
 DBMS versus DSMS
• Persistent relations
• Transient streams (and persistent relations)
 DBMS versus DSMS
• Persistent relations
• Transient streams (and persistent relations)
Challenges of Stream Data Processing
 Multiple, continuous, rapid, time-varying, ordered streams
 Main memory computations
 Queries are often continuous
 Evaluated continuously as stream data arrives
 Answer updated over time
 Queries are often complex
 Beyond element-at-a-time processing
 Beyond relational queries (scientific, data mining, OLAP)
 Multi-level/multi-dimensional processing and data mining
 Most stream data are at pretty low-level or multi-dimensional in nature
Processing Stream Queries
 Query types
 One-time query vs. continuous query (being evaluated continuously as stream continues to arrive)
 Predefined query vs. ad-hoc query (issued on-line)
 Unbounded memory requirements
 For real-time response, main memory algorithm should be used
 Memory requirement is unbounded if one will join future tuples
 Approximate query answering
 With bounded memory, it is not always possible to produce exact answers
 High-quality approximate answers are desired
 Data reduction and synopsis construction methods
 Sketches, random sampling, histograms, wavelets, etc.
Methods for Approximate Query Answering
 Sliding windows
 Only over sliding windows of recent stream data
 Approximation but often more desirable in applications
 Batched processing, sampling and synopses
 Batched if update is fast but computing is slow
 Compute periodically, not very timely
 Sampling if update is slow but computing is fast
 Compute using sample data, but not good for joins, etc.
 Synopsis data structures
 Maintain a small synopsis or sketch of data
 Good for querying historical data
 Blocking operators, e.g., sorting, avg, min, etc.
 Blocking if unable to produce the first output until seeing the entire input
 Projects on DSMS (Data Stream Management System)
Research project and implimentations and system prototypes
 STREAM (Stanford): A general-purpose DSMS
 Cougar (Cornell): sensors
 Aurora (Brown/MIT): sensor monitoring, dataflow
 Hancock (AT&T): telecom streams
 Niagara (OGI/Wisconsin): Internet XML databases
 OpenCQ (Georgia Tech): triggers, incr. view maintenance
 Tapestry (Xerox): pub/sub content-based filtering
 Telegraph (Berkeley): adaptive engine for sensors
 Tradebot ( stock tickers & streams
 Tribeca (Bellcore): network monitoring
 Streaminer (UIUC): new project and implimentation for stream data mining
Stream Data Mining vs. Stream Querying
 Stream mining—A more challenging task
 It shares most of the difficulties with stream querying
 Patterns are hidden and more general than querying
 It may require exploratory analysis
 Not necessarily continuous queries
 Stream data mining tasks
 Multi-dimensional on-line analysis of streams
 Mining outliers and unusual patterns in stream data
 Clustering data streams
 Classification of stream data
Challenges for Mining Unusual Patterns in Data Streams
 Most stream data are at pretty low-level or multi-dimensional in nature: needs ML/MD processing
 Analysis requirements
 Multi-dimensional trends and unusual patterns
 Capturing important changes at multi-dimensions/levels
 Fast, real-time detection and response
 Summary
 Stream data analysis: A rich and largely unexplored field
 Current research focus in database community: DSMS system architecture, continuous query processing, supporting mechanisms
 Stream data mining and stream OLAP analysis
 Powerful tools for finding general and unusual patterns
 Largely unexplored: current studies only touched the surface
 Lots of exciting issues in further study
 A promising one: Multi-level, multi-dimensional analysis and mining of stream data
 What Is A Continuous Query ?
Query which is issued once and logically run continuously.
 What is Continuous Query ?
Query which is issued once and run continuously.
 What is Continuous Query ?
Query which is issued once and run continuously.
 Special Challenges
Timely online answers even for rapid data streams
Ability of fast access to large portions of data
Processing of multiple streams simultaneously
 Making Things Concrete
 Making Things Concrete
 Database = two streams of mobile call records
 Outgoing(connectionID, caller, start, end)
 Incoming(connectionID, callee, start, end)
 Query language = SQL
FROM clauses can refer to streams and/or relations
 Query 1 (self-join)
Find all outgoing calls longer than 2 minutes
SELECT O1.call_ID, O1.caller
FROM Outgoing O1, Outgoing O2
WHERE (O2.time – O1.time > 2
AND O1.call_ID = O2.call_ID
AND O1.event = start
AND O2.event = end)
 Result requires unbounded storage
 Can provide result as data stream
 Can output after 2 min, without seeing end
 Query 2 (join)
Pair up callers and callees
SELECT O.caller, I.callee
FROM Outgoing O, Incoming I
WHERE O.call_ID = I.call_ID
 Can still provide result as data stream
 Requires unbounded temporary storage …
 … unless streams are near-synchronized
 Query 3 (group-by aggregation)
Total connection time for each caller
SELECT O1.caller, sum(O2.time – O1.time)
FROM Outgoing O1, Outgoing O2
WHERE (O1.call_ID = O2.call_ID
AND O1.event = start
AND O2.event = end)
GROUP BY O1.caller
 Cannot provide result in (append-only) stream.
• Output stream with updates
• Provide current value on demand
• Keep answer in memory
 Conventional DBMS technology is inadequate
 We need reconsider all aspects of data management and processing in presence of data streams

Important Note..!

If you are not satisfied with above reply ,..Please


So that we will collect data for you and will made reply to the request....OR try below "QUICK REPLY" box to add a reply to this page

Quick Reply
Type your reply to this message here.

Image Verification
Please enter the text contained within the image into the text box below it. This process is used to prevent automated spam bots.
Image Verification
(case insensitive)

Possibly Related Threads...
Thread Author Replies Views Last Post
  ONLINE EL-CHICO RESTAURANT MANAGEMENT SYSTEM seminar flower 1 642 08-04-2016, 11:10 AM
Last Post: mkaasees
  PROJECT ON HOSPITAL MANAGEMENT SYSTEM seminar flower 1 951 01-04-2016, 11:54 AM
Last Post: mkaasees
  ABSTRACT ON REPORT HOSPITAL MANAGEMENT SYSTEM study tips 1 588 01-04-2016, 11:53 AM
Last Post: mkaasees
  Privacy-Preserving Public Auditing for Data Storage Security in Cloud Computing PPT project girl 1 1,027 21-10-2015, 01:52 PM
Last Post: Guest
  HOSTEL MANAGEMENT SYSTEM pdf seminar tips 3 7,614 09-12-2014, 03:42 PM
Last Post: mkaasees
  Data Hiding in Video using Least Bit Technique seminar tips 1 600 18-10-2014, 05:40 AM
Last Post: wayan sukadana
  data mining full report project report tiger 35 199,294 03-10-2014, 04:30 AM
Last Post: kwfEXGu
  A Novel Data Embedding Method Using Adaptive Pixel Pair Matching Report project girl 4 1,876 18-09-2014, 03:49 PM
Last Post: Radhika.m
  scholarship MANAGEMENT SYSTEM seminar tips 6 5,136 12-08-2014, 07:56 AM
Last Post: donsilver
  Color Lab Management System seminar ideas 9 5,345 11-06-2014, 10:04 AM
Last Post: seminar project topic