JanusGraph 使用

1 .Community-Driven Graphs with JanusGraph Jing Chen He • jinghe@us.ibm.com • Apache HBase PMC • JanusGraph TSC Jason Plurad • pluradj@us.ibm.com • Apache TinkerPop PMC • JanusGraph TSC HBaseCon West 2017 • June 12, 2017 

2 .Agenda Property Graphs Graph Community Introduction to JanusGraph JanusGraph with HBase 2 #HBaseCon 

3 .Graph  Born for relationship!  Intuitive modeling  Expressive querying  Native analysis https://tinkerpop.apache.org/docs/3.2.4/reference/#intro 3 #HBaseCon 

4 .Graph Data Use Cases  Social network analysis  Configuration management database  Master data management  Recommendation engines  Knowledge graphs  Internet of things  Cybersecurity attack analysis 4 #HBaseCon 

5 .Apache TinkerPop  Open source, vendor-agnostic, graph computing framework  Gremlin graph traversal language Apache TinkerPop™ Maintainer Apache Software Foundation License Apache Latest Release 3.2.4 February 2017 https://tinkerpop.apache.org 5 #HBaseCon 

6 .Gremlin Graph Traversal Language https://tinkerpop.apache.org/gremlin.html 6 #HBaseCon 

7 .TinkerPop Stack https://tinkerpop.apache.org/docs/3.2.4/reference/#_graph_system_integration 7 #HBaseCon 

8 .Graph Landscape https://tinkerpop.apache.org/gremlin.html#oltp-and-olap-traversals 8 #HBaseCon 

9 . Scalable graph database distributed on multi-machine clusters with pluggable storage and indexing  Fully-compliant with Apache TinkerPop graph computing framework JanusGraph™  Vendor-neutral, open community with Maintainer Linux open governance Foundation – Founding members: Expero, Google, GRAKN.AI, Hortonworks, IBM License Apache – Latest members: Amazon, Netflix, Orchestral Latest 0.1.0 Developments, Uber Release April 2017 https://janusgraph.org 9 #HBaseCon 

10 . Architecture Google Cloud Bigtable 10 #HBaseCon http://docs.janusgraph.org/latest/arch-overview.html 

11 . Storage Model http://docs.janusgraph.org/latest/data-model.html#_janusgraph_data_layout 11 #HBaseCon 

12 . Storage Model http://docs.janusgraph.org/latest/data-model.html#_individual_edge_layout 12 #HBaseCon 

13 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Big enough for your biggest graph!  The storage model  Read and write speed  Scalability and partitioning  Strong consistency  Tight integration with Hadoop Ecosystem  Great open community! http://docs.janusgraph.org/latest/hbase.html 13 #HBaseCon 

14 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Simple configuration!  conf/janusgraph-hbase-solr.properties  storage.backend=hbase  storage.hostname=zookeeper-host1,zookeeper-host2,zookeeper-host3  storage.hbase.table=janusgraph  storage.hbase.ext.zookeeper.znode.parent=/hbase Optional  storage.hbase.ext.hbase.zookeeper.property.clientPort=2181 Optional  Just open your graph!  graph=JanusGraphFactory.open('conf/janusgraph-hbase-solr.properties') 14 #HBaseCon 

15 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Throw in an Index Backend for better performance  conf/janusgraph-hbase-solr.properties  index.search.backend=solr  index.search.solr.mode=cloud  index.search.solr.zookeeper-url=zookeeper-host1:2181/solr,zookeeper- host2:2181/solr,zookeeper-host3:2181/solr  index.search.solr.configset=janusgraph 15 #HBaseCon 

16 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details  Stores to Column Families  Edge store  e  Index store  g  ID store  i  Transaction log store  l  System property store  s  CF attributes can be set. E.g. compression, TTL. 16 #HBaseCon 

17 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details g.V().has("name", "Alice").out("knows").out("knows").values("name") Query Plan to Backend Store and Index Edge Store Index Index Store provider 17 #HBaseCon 

18 . with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details  A store (column family) is always specified.  Get or Multi Get  Batch to mutate Edge Store  Key range scan  ColumnRangeFilter Index Store  ColumnPaginationFilter  HBase tuning 18 #HBaseCon 

19 . with Google Cloud Bigtable  Bigtable implements the HBase 1.0 client API  Need the latest version of the bigtable-hbase-1.0 artifact.  storage.backend=hbase  storage.hbase.ext.hbase.client.connection.impl= com.google.cloud.bigtable.hbase1_0.BigtableConnection  storage.hbase.ext.google.bigtable.project.id= <Google Cloud Platform project id>  storage.hbase.ext.google.bigtable.instance.id=<Bigtable instance id> 19 #HBaseCon 

20 .Thank you!