Graph Analytics Using ArcGIS Knowledge

TimothyKinlaw

This two-day course introduces foundational concepts, terminology, and workflows to perform graph analysis using ArcGIS Knowledge. Learn how to visualize and analyze spatial, nonspatial, structured, and unstructured data together in a knowledge graph, and build skills to combine graph analysis with spatial analysis to uncover relationships and hidden patterns in large amounts of data.

Quick links to lessons:

• Lesson 1: Introducing ArcGIS Knowledge
• Lesson 2: Modeling data
• Lesson 3: Preparing data
• Lesson 4: Loading data
• Lesson 5: Managing data
• Lesson 6: Performing graph analysis
• Lesson 7: Querying data
• Lesson 8: Conducting spatial analysis

Lesson 1: Introducing ArcGIS Knowledge

• ArcGIS Knowledge product page
• Pro help documentation:
  • What is a link chart?  Get started with ArcGIS Knowledge
  • Explore an investigation and its knowledge graph
  • Essential ArcGIS Knowledge vocabulary
• ArcGIS Enterprise help documentation:
  • What is ArcGIS Knowledge?
  • Configure ArcGIS Knowledge
  • Considerations for Neo4j databases used as NoSQL data stores
• Videos
  • ArcGIS Knowledge: An Overview (UC 2023)
• Other:
  • 7 Use Cases for Graph Databases and Graph Analytics (Oracle)
  • Graph Databases for Beginners: Graph Theory & Predictive Modeling by Neo4j blog

Lesson 2: Modeling data

• What is data modeling? (IBM)
• Arrows.app
• Graph Data Science Use Cases: Entity Resolution

Lesson 3: Preparing data

• ArcGIS Pro:
  • Data Engineering – Prepare Data
  • Alter Field (Data Management) - a use case for this tool: when using the Load Table Wizard, if a field contains the text "name" in it and is used as a property, that field name becomes the Display Name for that entity or relationship in the investigation view. Otherwise, you can not fully control what the Display Name is.
  • Calculate Field (Data Management)
  • Find and Replace (Edit tabular data)
  • Edit feature attributes (Attribute pane)
  • ArcGIS Interoperability
  • ArcGIS LocateXT
    • These tools are available in the AllSource Toolbox and the Conversion Toolbox. Since this functionality is exposed through geoprocessing tools, these processes can be automated with arcpy in Python.
      • Create Location File From Text File (AllSource)
      • Extract Locations From Text (Conversion)
      • Extract Locations From Document (Conversion)
  • Text Analysis toolset in ArcGIS Pro’s GeoAI toolset
• Videos & Blogs:
  • Advanced Analytics Using Knowledge Graphs (UC 2023) 
  • Text Analysis using Natural Language Processing (NLP) in ArcGIS Pro 3.0 
  • Deep Learning Libraries Installers for ArcGIS (GitHub) 
  • Use the Named Entity Recognition model 
  • Extract Entities Using Deep Learning (GeoAI)

Lesson 4: Loading data

• ArcGIS API for Python:
  • Introduction to Knowledge Graphs
  • Edit Knowledge Graphs
  • arcgis.graph module
  • Create and load knowledge graph backups
• ArcGIS Pro:
  • ArcGIS Data Interoperability extension 
  • ArcGIS Knowledge handles loading coordinates the same as LocateXT. Here is the documentation for this.
  • Load data into a knowledge graph
  • Create an investigation in a project (be sure to refresh if collaborating on the knowledge graph)
  • Add documents to a knowledge graph
  • Introduction to Data Engineering
  • Explore a knowledge graph with histograms
  • Add provenance to a knowledge graph

Lesson 5: Managing data

• Edit a knowledge graph in a link chart
• Merge entities and relationships

Lesson 6: Performing graph analysis

• Graph analysis concepts:
  • Graph theory and link chart concepts
  • Compute centrality scores to measure the importance of entities
  • Centrality Algorithms | Graph Data Science by Neo4j (video)
  • Graph Analytics — Introduction and Concepts of Centrality by TowardsDataScience on Medium (blog)
  • Centrality and centrality measures by IBM's i2 Analyst's Notebook
  • Graph Data Science with Neo4j Graph Algorithms by Neo4j (video)
  • ArcGIS Knowledge: Finding Patterns in Health Data for Early Intervention  (Show cases pattern matching) (Lightning talk video)

Lesson 7: Querying data

• ArcGIS Pro/ArcGIS Knowledge help documentation:
  • Search the knowledge graph
  • Explore a knowledge graph with histograms
  • Select and filter content with histograms
  • Query the contents of a knowledge graph
  • This developer’s documentation may help clarify the difference between “Search” and “Query”.
  • Write an openCypher query
  • Query a knowledge graph  (ArcGIS Knowledge Server/Enterprise documentation)
  • Use date-time values in a query
  • Spatial operators
    • See this developer documentation for a description of how these spatial operators are defined. openCypher does not use all spatial relationships.
    • See this enterprise documentation for a discussion on spatial operator usage.
• Cypher/openCypher references:
  • openCypher references
  • Cypher language reference
  • Neo4j Cypher Introduction
  • openCypher's Style Guide on GitHub
  • Examples of various applications of openCypher on GitHub
  • Cypher Cheat Sheet by Neo4j

Lesson 8: Conducting spatial analysis

• Analyze spatial entities
• Add a knowledge graph to a map or scene
• Query a knowledge graph - use spatial operators in a query
• ArcGIS Knowledge: Supply Chain Visualization & Analysis (blog)