Download presentation
Presentation is loading. Please wait.
1
CCF ADL66大数据管理系统和技术 刘达欣 2018/11/28
2
日程 5月28日 上午:Spatial Crowdsourcing, Opportunities and Challenges 陈雷，香港科技大学副教授 下午:Towards Interactive Big Spatial Data Analytics 李飞飞，美国犹他大学副教授 5月29日 上午:Big Indoor Traffic Data---Cleansing, Querying, and Mining 路华，丹麦奥尔堡大学副教授 下午:Graph-Based RDF Data Management 邹磊，北京大学副教授 5月30日 上午:洞察大数据－通过可视分析理解大数据 袁晓如，北京大学研究员 2018/11/28
3
Spatial Crowdsourcing, Opportunities and Challenges --陈雷
Gmission Demo System.(open source on github) Three aspect in crowdsourcing: 激烈机制 Non-Monetary Incentive(如设计用户游戏,验证码等) Monetary Incentive(好钢用在刀背上，如用户标注) 任务分配 Server-Assigned-Tasks Mode Algorithm Worker-Selected-Tasks Mode Algorithm 质量控制 Pre-task execution , Post-task execution Training-Feedback method 2018/11/28
4
Towards Interactive Big Spatial Data Analytics --李飞飞
面向空间数据分析的分布式数据库管理系统。Based on spark SQL 2018/11/28
5
Towards Interactive Big Spatial Data Analytics --李飞飞
Framework 面向空间数据分析的分布式数据库管理系统。Based on spark SQL 2018/11/28
6
Towards Interactive Big Spatial Data Analytics --李飞飞
High level API 查询接口。 2018/11/28
7
Towards Interactive Big Spatial Data Analytics --李飞飞
Other technology: Indexing (Global+Local) Spatial operations Query optimizer Conclusion 查询接口。 2018/11/28
8
Big Indoor Traffic Data---Cleansing, Querying, and Mining –陆华
Agenda Cleansing Indoor RFID Tracking Data Querying Online Indoor Moving Objects Mining Indoor Mobility Data 查询接口。 2018/11/28
9
Big Indoor Traffic Data---Cleansing, Querying, and Mining –陆华
Cleansing Indoor RFID Tracking Data Data：<objectID,readerID,t> False Positive & False Negative 查询接口。 2018/11/28
10
Big Indoor Traffic Data---Cleansing, Querying, and Mining –陆华
Cleansing Indoor RFID Tracking Data Graph-Based Method (objectID, readerID, t)* → (objectID, readerID, [ts, te]) Fasle Positive例子 2018/11/28
11
Big Indoor Traffic Data---Cleansing, Querying, and Mining –陆华
Cleansing Indoor RFID Tracking Data Learning Method EM算法学习参数 Viterbi算法做预测 Fasle Positive例子 2018/11/28
12
Big Indoor Traffic Data---Cleansing, Querying, and Mining –陆华
Querying Online Indoor Moving Objects Continuous Range Monitoring Query k Nearest Neighbor Query Improving Query Result by Using Particle Filters Mining Indoor Mobility Data Identifying Typical Movements among Indoor Objects Finding Frequently Visited Indoor POIs 这两部分内容没听懂，只知道大概的目标 Fasle Positive例子 2018/11/28
13
Graph-Based RDF Data Management --邹磊
RDF Introduction（略） Centralized System Relational Approaches Graph-based Approaches （gStore） Distributed System Existing solution Proposed Method QA over knowledge graph Proposed Method (gAnswer) RDF数据存储 2018/11/28
14
Graph-Based RDF Data Management --邹磊
Centralized System Relational Approaches 1.属性表(基于类) 优点:减少self-join 缺点:null值数据太多，多值数据不好处理 RDF数据存储 2018/11/28
15
Graph-Based RDF Data Management --邹磊
Centralized System Relational Approaches 2.二进制表(基于predicate,再对subject进行排序) 优点:多值处理方便，没有null，s-s join很快 缺点:s-o join没用 RDF数据存储 2018/11/28
16
Graph-Based RDF Data Management --邹磊
Centralized System Relational Approaches 3. Exhaustive Indexing 优点:Join很快 缺点: 空间开销大。 创建SPO,SOP,PSO,POS,OPS,OSP 6种索引 RDF数据存储 2018/11/28
17
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
18
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
19
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
20
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
21
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
22
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
23
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
24
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
25
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
26
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
27
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
28
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
29
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
30
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
31
Graph-Based RDF Data Management --邹磊
Centralized System Graph-based Approaches（gStore） RDF数据存储 2018/11/28
32
Graph-Based RDF Data Management --邹磊
RDF Introduction（略） Centralized System Relational Approaches Graph-based Approaches （gStore） Distributed System Existing solution Proposed Method QA over knowledge graph Proposed Method (gAnswer) RDF数据存储 2018/11/28
33
Graph-Based RDF Data Management --邹磊
Distributed System Existing solution GraphPartition [Huang et al., 2011] Vertex-block [Lee and Liu, 2013] HadoopRDF [Husain et al., 2011] DARQ [Quilitz and Leser, 2008] RDF数据存储 2018/11/28
34
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
35
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
36
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
37
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
38
Graph-Based RDF Data Management --邹磊
Distributed System System Framework:Overview RDF数据存储 2018/11/28
39
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
40
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
41
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
42
Graph-Based RDF Data Management --邹磊
Distributed System RDF数据存储 2018/11/28
43
Graph-Based RDF Data Management --邹磊
Distributed System BSP 模型 RDF数据存储 2018/11/28
44
Graph-Based RDF Data Management --邹磊
RDF Introduction（略） Centralized System Relational Approaches Graph-based Approaches （gStore） Distributed System Existing solution Proposed Method QA over knowledge graph Proposed Method (gAnswer) RDF数据存储 2018/11/28
45
Graph-Based RDF Data Management --邹磊
QA over knowledge graph Data diven RDF数据存储 2018/11/28
46
洞察大数据－通过可视分析理解大数据 --袁晓如，北京大学研究员
北京大学轨迹可视化(TrajectoryVis)系统 微博足迹可视化分析工具 RDF数据存储 2018/11/28
47
洞察大数据－通过可视分析理解大数据 --袁晓如，北京大学研究员
北京大学轨迹可视化(TrajectoryVis)系统 交通轨迹可视化析工具 RDF数据存储 2018/11/28
48
Thanks Q&A RDF数据存储 2018/11/28
Similar presentations
