Skip navigation
All Places > Sciences > Blog
1 2 Previous Next

Sciences

18 posts

Updated: October 12, 2018

 

Jump to: Major Initiatives | Collaborative Projects | Staying Connected | Deepsea Dawn
UC Science Symposium Hot! | R - ArcGIS Integration Hot! | ArcGIS Python API Hot!
|

Geo AI & Machine Learning Hot! | DID YOU KNOW?

 

Science at Esri continues to evolve on many exciting fronts, as we focus on supporting both basic and applied science, while also recognizing that there are many major themes of compelling interest to society that will drive scientific research for the next several decades. Thus we view science as helping us to understand not only how the Earth works, but also how the Earth looks (e.g., by way of geodesign), and how we look at the Earth (i.e., by way of Earth observation in varying forms and the accompanying data science issues of analysis, modeling, developing and documenting useful datasets for science, interoperating between these datasets and between various approaches). These are, in fact, examples of The Science of WhereTM.

 

There are many major themes of compelling interest to society that will drive scientific research, at least for the next two decades. And thus we view science as helping us to understand not only how the Earth works, but how the Earth should look, and how we should look at the Earth.

There are many major themes of compelling interest to society that will drive scientific research, at least for the next two decades. And thus we view science as helping us to understand not only how the Earth works, but how the Earth should look, and how we should look at the Earth.

 

In addition to supporting the science community, we seek to do good science at Esri ourselves, as it underpins much of what we do as an organization. This is helping us to evolve ArcGIS into a comprehensive geospatial platform for science; a platform that supports research project management and collaboration, spatial analysis, visualization, open data, and communication of science, all at multiple scales (i.e., from individual researcher to lab workgroup, to multi-department, multi-university, university-to-agency collaboration, to citizen engagement).

 

There are many natural science domains in which GIS is being used effectively to understand how the Earth works. At Esri, these are the sciences that we are particularly strong in

There are many natural science domains in which GIS is being used effectively to understand how the Earth works. At Esri, these are the sciences that we are particularly strong in.

 

Along these lines, Esri is fairly well known to research labs, universities, and other places where great science is done as a vendor of GIS technology. However, Esri continues to work toward contributing as a MEMBER of the scientific community as well. We define the "science community" as scientists within universities, research institutes, government agencies, non-governmental organizations (NGOs), and similar. As such, Esri maintains objective scientific representation on various scientific boards and councils, including several of the committees within these bodies that accomplish important tasks over the long-term. Examples include:

Esri also serves on various advisory boards or collaborative research teams for specific scientific projects, such as:

Back to top

Our Major Initiatives and Projects

      • Esri has a new initiative in Artificial Intelligence and Machine Learning. We now have "GeoAI" resources and demos on GitHub (must be signed in), and a recent blog post on possible machine learning implementations in ArcGIS. See also The Science of Where Seagrasses Grow: ArcGIS and Machine Learning. Esri has also entered a new partnership with Microsoft in the realm of Artificial Intelligence that includes Esri technology now incorporated within Microsoft's Data Science Virtual Machine (i.e., ArcGIS Pro and the R-ArcGIS Bridge). Researchers can now apply for cloud computing grants under this initiative. This is part of Microsoft's exciting new AI for Earth Initiative which may become "a game-changer for our planet."
      • Tools and workflow packages such as Scientific Data Workflows, and Dimension Explorer, and 3D Fences and Curtains. See more at ArcGIS Code Sharing.
      • Fostering compelling cartography, design, and research as part of the amazing world of cartographic science (including Adventures in Mapping, Maps We Love and the definitive text Map Use: Reading, Analysis, Interpretation. See also the related Cartography MOOC (Massive Open  Course).
      • Release of the First Ecological Land Units (ELUs) Map of the World. GEO/GEOSS commissioned the USGS to create a new map of global terrestrial ecosystems for a host ecosystem research and management applications, including assessments of climate change impacts to ecosystems, economic and non-economic valuation of ecosystem services, and conservation planning. Under the leadership of Dr. Roger Sayre of the USGS, in collaboration with Esri and several agencies and organizations, global terrestrial ecosystems are now characterized in an ecophysiographic stratification comprised of nearly 4000 terrestrial ELUs, at a base resolution of 250 m. Datasets from the study are shared in a series of web services as part of the Living Atlas of the World, thereby representing the most current, accurate, comprehensive, and finest-resolution available globally for each of the four inputs: bioclimate, landform, lithology, and land cover. This project was officially released at the 2014 ACES Conference (A Community on Ecosystem Services) in December. See the related blog post, technical report, story map, web app, and an ArcGIS  content white paper.
      • To complement the Ecological Land Units, we have also built the first ever, robust, standardized, data-derived map of global marine ecosystems, the Ecological Marine Units (EMUs). The project was commissioned as an official task for the second decade (2016-2025) of the Group on Earth Observations (GEO), as part of the GEO Global Ecosystems (GECO) initiative. An initial advisory group includes scientists from the USGS, University of Auckland, GRID-Arendal, the Marine Conservation Institute, NatureServe, NOAA, and Duke University. The environmental stratification approach will involve creating an empty, volumetric column-based mesh as a global, spatial reference standard and analytical framework, populating the spatial framework with relevant marine physical environment data including water column variables and seafloor geomorphological features, and clustering the abiotic data into ecologically meaningful, 3D regions represented as volumetric polygons. The EMUs will subsequently be analyzed against species distribution data to assess strength of relationship between distinct abiotic environments and species biogeography. Initial results were presented at the Global Marine Protected Areas Summit and the Esri Ocean GIS Forum, both in November. See video 1 and video 2, as well as this 2017 News feature in the journal Nature.
      • Ecological Coastal Units (ECUs) are now in production! Stay tuned!
      • A Global Population Map. For many years, Esri has been compiling a human geography database of demographics and statistics about all countries in the world, and mapping these datasets using an innovative methodology. See info on Esri's new World Population Estimate, a probability surface that estimates the location and count of people worldwide, freely available to researchers.
      • Spatial Analysis including Spatial Statistics: Several collections of tools in ArcGIS Pro and ArcMap include scores of new functions for space-time pattern analysis and mining (including space-time cube visualization and analysis of changes in temporal trends at a location), raster segmentation and processing, working with 3D and LAS (LiDAR) datasets, pairwise feature processing, suitability modeling, cost distance analysis, data review, and workflow management. For the latest from our Spatial Statistics team, see the comprehensive Spatial Statistics Resources Site, frequently updated.
      • Imagery: ArcGIS provides a comprehensive platform for working with imagery and making your imagery useful, including advanced image management and processing, and robust analysis tools. As example see how the NASA Langley Atmospheric Science Data Center (ASDC) Distributed Active Archive Center (DAAC) is improving the accessibility and use of Earth science data with this platform (esriurl.com/nasa and webinar video). And for over 9000 universities across the world this imagery platform and a wealth of imagery data are already freely available under their campus site licenses. See esrirul.com/imagery and some pretty amazing explorations of Landsat at esriurl.com/secrets. The new Imagery Workflows site shares a variety of tools and best practices for managing, analyzing, and using imagery and related rasters. See the related Earth Imagery MOOC (Massive Open  Course).
      • Big Data: Researchers today need to deal with an avalanche of data—from environmental sensor networks (both on land and at sea), social media feeds, LiDAR, and outputs from global- and regional-scale atmospheric circulation and general climate models and simulations. Because of this, “big data” has emerged as a major research theme for the academic community. In 2013, Esri developers released the GIS Tools for Hadoop Project on GitHub. The project contains an open source framework and API that enables big data developers to author custom spatial applications for Hadoop. The GIS Tools project also enables the ArcGIS platform to leverage big data on Hadoop using tools that combine custom Hadoop applications with the ArcGIS Geoprocessing environment. The project supports processing of simple vector data (points, lines, polygons) and basic analysis operations, e.g. relationship analysis on that data, running in a Hadoop distributed processing environment. See also this overview.
      • Basemaps: Many in the scientific community are interested in and participate in our Community Maps Program. This is in the spirit of crowdsourcing of authoritative content from the community, that Esri then hosts free in the cloud and for which contributors retain ownership and are acknowledged. In terms of GIS analysis directly within the web browser, the geo-analytics web services that Esri offers for hydrologic science are the most advanced thus far.
      • Story Maps: Story maps allow scientists to make their data and analyses more accessible to their colleagues as well as to policy-makers and citizens (example). Think of the power of telling a 30-second elevator speech about your research to a funder or policy-maker as a story map! Templates and tutorials are available at storymaps.arcgis.com. Related resources: An Ocean of Story Maps | Speaking the “Language” of Spatial Analysis via Story Maps | ArcGIS and Citizen Science.
      • Great science books from Esri Press (with more to come): Imagery and GIS: Best Practices for Extracting Information from Imagery shows how imagery can be integrated successfully into GIS maps and scientific analysis. Mapping and Modeling Weather and Climate with GIS features leading climatologists, meteorologists, and other experts sharing approaches to advance atmospheric and ocean science through GIS. Ocean Solutions, Earth Solutions, 2nd edition, is an externally peer-reviewed research monograph based on papers presented at the inaugural Esri Ocean GIS Forum. It is about use-inspired science and realistic solutions for mapping, monitoring and protecting the ocean, hence the entire Earth. It is the first Esri Press book to employ Digital Object Identifiers (DOIs) for citation of both the book and its supplementary datasets (further reading on citations). GIS Research Methods: Incorporating Spatial Perspectives shows researchers how to incorporate spatial thinking and GIS technology into research design and analysis. It should also be incredibly useful in the classroom. Map Use, now in it's 8th edition, is a comprehensive, foundational textbook designed for undergraduate and graduate coursework, and newly updated with chapters on web mapping and web map design. Cartography. is a lavishly illustrated reference guide that skillfully navigates the intersection between science and art.
      • Citizen science taking more center stage, including Esri participation at the inaugural Citizen Science Association Conference, a range of apps to support citizen science projects, and exciting implementations, including at the White House Science Fair. Apps include Collector for ArcGIS, Survey123, Crowdsource Reporter for Citizen Science, Water Quality Status, My Hazard, and for your own customized apps from scratch, Web App Builder for ArcGIS. The Story Map Crowdsource Builder for citizen science was released in 2015. See also this great overview of the latest Citizen Science Resources from Esri and partners, as well as the Federal Crowdsourcing and Citizen Science Toolkit.
      • Various science-themed contests including prior: Global Disaster Resilience App Challenge Winners + Data Viz App Challenge Winners + Global Content Challenge Winners
      • The Ocean: In 2012 Esri launched an Ocean GIS initiative across the entire Esri organization to enhance our capabilities to support GIS in both coastal and open ocean applications. As mentioned before in Esri Insider, Esri is particularly focused on a greater engagement with the ocean science community, as complex ocean science questions and data are increasingly used to inform the responsible use and governance of the oceans, as well as effective management and conservation. To support a better overall understanding of our oceans, Esri aims to improve and expand its products, tools, services, partnerships, and connections with the broader ocean community. We continue to evolve in this area via the annual Esri Ocean GIS Forum, held in November at our headquarters in Redlands, CA. We are also providing a wide range of ocean content through the Living Atlas of the World.


Across the entire Esri organization we now have an Ocean GIS initiative, including a comprehensive strategic plan and an oceans/maritime resource center.  We’re also working with a growing list of terrific partners.

 

Across the entire Esri organization we have an Ocean GIS initiative that was built on a comprehensive strategic plan. We're also working with a growing list of terrific partners.

 

Back to top

Collaborations with Partners in the Academic, Government, and NGO Sectors

  • Updated! Continuing collaborations with NOAA, including support of their enterprise GIS operations within the National Weather Service, and within that the National Ice Center (NIC). The NIC's Satellite Image Processing and Analysis System is one of the assets ensuring safe navigation in polar regions for ships operating near, through, and beneath sea ice, guided by ArcGIS sea-ice and iceberg maps.
  • New! Oak Ridge National Laboratory (ORNL) within the Department of Energy (DOE): Esri has entered into a semi-exclusive agreement with ORNL to distribute their LandSCAN and LandCAST data settlement mapping population data. LandSCAN is an authoritative, high-resolution (1-km), global dataset of population distribution. LandCAST is an empirically-informed spatial distribution of projected population of the contiguous U.S. for 2050 compiled on a 1-km grid. ORNL is also experimenting with the latest Esri platform capabilities for advancing their global and regional population density analyses. There is interest in Esri's new "accelerated processing" capabilities for applying ORNL's current algorithms for image extraction (e.g., buildings), as executed within ORNL's LandScan application, and in Esri's new orthorectification capabilities, and real-time collection of big data feeds.
  • New! US Census and Housing and Urban Development (HUD): Collaboration efforts include modernization of enumeration, route optimization, change detection, and dissemination processes at Census, and development of the Community Assessment Reporting Tool (CART) at HUD to map and spatially explore investments by city, state, county, metropolitan area, or congressional district. Census is also testing raster analytics functions with remote sensing data in support of international surveys and the potential generation of supplemental, non-official products to assist with the 2020 Census.
  • 52 North: Various projects focused on interoperable processing of sensor data and advancement of spatial data infrastructures via publish/subscribe interaction patterns. For example, Sharing Geoprocessing Tools via the Web (via OGC WPS).
  • Clark Labs of Clark University has worked with us for many years on modeling of Landsat data for population and land footprint growth, as well as as landscape vulnerability. Their agent-based growth simulation modeling and land cover data are a critical ingredient in our evolving Green Infrastructure project. The Esri Green Infrastructure app compares changes between aggregated 2011 National Land Cover Database land cover categories with similarly aggregated land cover categories from The Clark Labs 2050 Conterminous US Land Cover Prediction. It also provides a few summary statistics about possible changes in developed, forest and agricultural land cover. Look for the soon to be released Clark Labs American Land Change Explorer application, which provides exhaustive analysis and summaries of potential transitions from each of the NLCD categories to each of the projected 2050 categories.
  • University College London: Various small citizen science and urban risk/resilience projects, including story maps (example 1, example 2) with the Extreme Citizen Science (ExCiteS) lab of Professor Muki Haklay.
  • NASA: various experiments, prototypes and with climate, ocean, and hydrologic multidimensional datasets particularly with the NASA Earth Science Technology Office. Additional collaborations are ongoing with the NASA Disaster Assistance Program.
  • The GIS Program of the National Center for Atmospheric Research (NCAR) is working with us on developing a series of web services to provision climate data (e.g., netCDF) within the Living Atlas of the World to drive some amazing new apps, particularly in support of the NCAR Community Earth System Model (CESM). They have also worked with us on the development of a new LearnGIS module around the use of climate and weather data in GIS, and various other activities to further develop and strengthen the Weather, Climate and Atmospheric GIS Community.
  • Esri is also pleased to be working with Columbia University's Center for International Earth Science Information Network (CIESIN) as part of their POPGRID Open Data Collective. POPGRID is a consortium of population and settlement modelers from both the public and private sector that are working on integrated approaches to human settlement, infrastructure, and population mapping, including in support of the UN Sustainable Development Goals (SDGs).
  • University of Wollongong, Australia: Esri's Statistical Design Teams will be consulting with Distinguished Professor Noel Cressie and his research group on a range of development projects in areas including geostatistics, space-time pattern mining, R statistical software integration, and statistical clustering algorithms to optimize Esri ecophysiographic, ecological marine, and world population layers.
  • MIT: Esri's Chief Scientist teamed with the Esri Story Maps and Strategic Marketing Teams in a collaboration with Dr. Amy Glasmeier, Professor of Economic Geography and Regional Planning. The aim was to explore how to better "spatialize" her famous Living Wage Calculator, which analyzes the minimum level of income required for individuals and families to pay for basic living expenses. The result was the Living Wage Story Map in 2015 (now updated in 2018 to The Ever Changing Minimum Wage), which received hundreds of thousands of web hits upon its launch, and was featured in dozens of media outlets such as The Atlantic and Huffington Post, The Washington Post, and Politico.
  • Southern California Coastal Water Research Project (SCCWRP): Esri is working with SCCWRP on a variety of collaborative projects including the development of a desktop tool for the assessment of hydromodification via geomorphic landscape analysis. This assessment is focused on changes to stream runoff and sediment supply as a result of land use modifications. Also in the works are the design and development of decision-support tools for adaptation of coastal wetlands to sea level rise, and 3D visualizations for environmental decision support within estuaries.
  • UCSB's Space and Time Knowledge Organization (STKO) Lab: Esri and the STKO Lab of Professor Krzysztof Janowicz and his students are pursuing joint research projects of mutual benefit and interest in the areas of Linked Data, semantic search, data-mining-based metadata enrichment, and geo-ontology. This includes experimenting with the ArcGIS ingestion of ontologies and Linked Data for data queries and the associated issues of user experience (UX), semantic search, automatic interpretation, web analytics, and more.
  • The University of Bamberg in Germany partnered with Esri on a project focusing on GeoGames and Playful Design, as a medium for education in spatial thinking, for problem-solving in spatial design. The Bamberg team has studied and developed location-based games for different educational scenarios (e.g. river ecology, cultural heritage), and continues to develop prototypes of games and design tools based on ArcGIS technology. See the project info. at www.geogames-team.org.
  • Indicator-based Interactive Decision Support and Information Exchange Platform for Smart Cities Planning (INDICATE): Our Zurich R&D Center partnered with IES (a leader in architecture, engineering, and construction or AEC simulation tools), Dublin Trinity College (providing numerical simulations), DHP Consulting (spatial planning experts), and D‘Appolonia (a large Italian AEC and connsulting firm) on this project. The goal is to create an interactive, instant Design-Validate-Feedback loop for urban planning, taking into account energy performance, livability. The project will also share best practices and their impacts using a neutral indicator framework to enable other to assess the effect of measures on their context.
  • SAFECITI: The Esri Zurich R&D Center partnered with Next Limit (3D Rendering), Golaem (Crowd Simulation), and the Spanish National Police in creating a virtual-reality training and simulation environment for organisations with security mandates using procedural content and crowd simulation. The aim is to develop a simulation platform that will help analysts predict crowd behavior under certain threats in order to help the police develop better safety plans.
  • Open Water Data Initiative: Esri is partnering with U-Texas-Austin, Kisters, the Open Geospatial Consortium (OGC), the US Geological Survey (USGS), the Consortium of Universities for Advancement of Hydrologic Science (CUASHI), and others in this project seeking to bring together water information for the whole Earth, at all spatial scales (global, regional, local), linking both geospatial and temporal information, and linking data with modeling.
  • KIC-T: The Esri Zurich R&D Center is partnering with ETH Zurich, IBM Research, and Birmingham City University on using real-time data and simulation for urban planning for climate-change resilient cities. This involves extending the Esri GeoEvent Processor to provide streams of 3D events to the ArcGIS Web3D platform, and in researching and implementing new visualization methods for these real-time streams.
  • Adaptive Composite Map Projections: In 2015 Esri completed a collaboration with Professor Bernard Jenny and his lab while at Oregon State University on integrating into the ArcGIS platform a composite adaptive map projection, which seamlessly morphs map space as the user changes map scale or the geographic region displayed (Jenny is now at Monash University in Australia). The composite projection adapts the map’s geometry to scale, to the map’s height-to-width ratio, and the central latitude of the displayed area by replacing projections and adjusting their parameters. The result is a scale-aware, adaptive projection, free of the constraint of having to deal with multiple zones or multiple sets of graticules, and ultimately free of the pitfalls of WEB MERCATOR!
  • and many more.

Back to top

Staying Connected

There are several ways to keep abreast of science developments at Esri:

  • Get involved in our GeoNet community. This is a different kind of resource center where YOU can provide content as the user and have an opportunity to interact directly with Esri staff or other users, including technical "how-to" questions. This gives us at Esri an opportunity not only to listen TO you, but to ask YOU questions as well. See also this helpful video on Getting Started in a GeoNet community.
  • Connect with our Government Teams which support NOAA, NASA, DOE, USGS, US Park Service, Census, EPA, USFW, USDA, etc., as well as natural resource agencies within state and local government agencies. See the Government Earth Sciences industry web site and brochure.
  • Follow several of the Esri Open  communities. These contains blog, Twitter streams, discussion forums, videos, case studies, maps, apps, data, and documentation, all of which contain significant content for the science community. Many of these resources are pre-selected to help users in a particular domain complete their work, without having to search through large volumes of content to find what best applies to that domain.
  • Bookmark the Applied Analysis site to view various modes of analysis from exploration to decision-making as demonstrated by example, where workflows and processes are shown, results are interpreted, data and models can be downloaded.
  • Bookmark the ArcGIS Pro web site, which has significant content for the science community, particularly with regard to geoprocessing and spatial analysis across many science domains.
  • If you enjoy Twitter, follow Esri Chief Scientist Dawn Wright via @deepseadawn, where she makes science and ocean-related postings daily, as well as the @gisandscience Twitter account.
  • Follow the GIS and Science blog of Matt Artz, to see the fascinating array of journal articles, books, and scholarly events where GIS technology is being used to advance scientific understanding.
  • Attend the Esri International User Conference, where there are always high-quality paper sessions and map galleries focused on a wide array of scientific themes (including the annual GIScience Research or Frontiers in GIScience sessions and the new Science Symposium). In addition, there are Special Interest Group (SIG) meetings, and science-related demo theaters (e.g., demo theaters by the wizards in our Applications Prototype Lab are always a treat for scientists).
  • Attend upcoming Esri specialist meetings with science themes (e.g., the Geodesign Summit, the Health and Human Services GIS Conference, the Ocean GIS Forum, the FedGIS Conference, etc.). Consider also the Esri Developer Summit. Information on all Esri events is available at esri.com/events.
  • Esri staffers also do great science themselves, and you are welcome to visit our Zotero library showcasing our publications.

This diagram shows the various aspects of our comprehensive program to support the science community, showing the interlinkages between and among universities, government agencies, and various consultancies, nonprofits, for profits, and other organizations focused on science. Contact the Chief Scientist, Dawn Wright, dwright-at-esri.com, for more information.

This diagram shows the various aspects of our comprehensive program to support the science community, showing the interlinkages between and among universities, government agencies, and various consultancies, nonprofits, for profits, and other organizations focused on science. Contact the Chief Scientist, Dawn Wright, dwright-at-esri.com, for more information.

 

Back to top

We are pleased to share a recap of the Esri User Conference Science Symposium, featuring the amazing climate scientist, Dr. Camilo Mora of the University of Hawaii. Unfortunately, we did not have the resources to record the session and Dr. Mora is unable to release his full slide deck due to the sensitivity of some material. But please find this Wakelet social media compilation --> 2018 Esri Science Symposium - Wakelet . And you can download the introductory slide deck of Esri Chief Scientist Dawn Wright at http://esriurl.com/symposium18 .

The new NOAA Climate Explorer developed with the Esri JS API launched publicly this week. Climate Explorer is a rich resource featuring more than just maps. This link will take you to an example map view in the new version

In short;

-          NOAA Climate Program Office, with NEMAC, created the original US Climate Explorer in 2014 with opensource tech

-          NEMAC and NOAA, with support from Fernleaf, have rewritten the Climate Explorer with the Esri JS API, and are integrating Living Atlas content directly into it.

o   The new site has an impressive multi-scale explorer interface for various layers, swipe tools, charts…. 6k grids for US/ or options for county-level aggregation

-          An update is planned with deeper Living Atlas and Story Map integration, launching early fall

-          Current case studies on the Climate Explorer site are being transitioned to Story Maps, including integration with the National Water Model for example.

-          NOAA Climate Program Office Director is pleased with the change to the ArcGIS JS API, and supportive of the planned Living Atlas enhancements

-          The new site is hosted on a NEMAC server, to ensure continuity during potential government shutdowns

 

Primary collaborators include;

- NOAA’s Climate Program Office

- UNC-Asheville’s NEMAC (National Environmental Modeling and Analysis Center – 2016 SAG Award for Research and Science),

- Fernleaf Interactive, an Esri Startup co-located with NEMAC at Asheville’s Climate Collider (collaborative office space)

-          NEMAC spun-off Fernleaf two years ago to handle commercial demand for resilience consulting to local gov market

  • Fernleaf now supports a product, AccelAdapt, an SAS resilience assessment solution for ArcGIS incorporating parcel and building data into the “Six Steps for Resilience” process. Workflows deliver ArcGIS Web Services as products to hundreds of communities

Related,

-          Fernleaf is sharing AccelAdapt workflows (which leverage the Climate Explorer)

-          Climate Explorer will feed inputs to AccelAdapt via the living Atlas in fall release

-          Fernleaf will be in the StartUp Zone at the Esri UC for the 2nd year.

 

This is an exemplar of an academic research team spinning-off a thriving Esri Startup, then providing the Climate Explorer as a critical public/ private partnership.

Great new story map debuted by Brett Rose of the Esri National Government Sciences Team today at the 2018 FedGIS Conference, with dynamic particle tracking and "message-in-a-bottle" functions embedded: 

 

What Causes Ocean Currents?

 

Thanks to Witold Fraczek for creating this extensive resource!

Dear Colleague,

 

As an attendee of either the 2018 Esri Education Summit or the 2018 Esri User Conference, you are warmly invited to a special event, the Esri Science Symposium.

 

When & Where:

Tuesday, July 10, 2018

4:00-6:30 pm

San Diego Convention Center (SDCC) Ballroom 20 D

The 2018 symposium will include the following:

  • A keynote address by Dr. Camilo Mora, University of Hawaii, about some of the most important climate change issues of the day, including deadly heat waves

 

 

  • Audience Q&A and interactive discussion

 

  • Networking reception with delicious appetizers and a hosted bar providing beer, wine, soft drinks, and bottled water

 

This event seeks to broaden the tent of Esri UC participation—beyond the traditional geographers and GIScientists—to include those working in the domain sciences (e.g., ocean science, hydrology, ecology, forestry, climate science, geology/geophysics, agricultural science, conservation biology, sustainability science and/or geodesign, health sciences, and the social sciences). A further aim is to strengthen the links between Esri and the scientific community, while (re)crystallizing a community of scientists at the Esri UC who normally attend disparate sessions throughout the week.

 

 

Please feel free to share this invitation (including the RSVP link) with others who might be interested.

 

We look forward to seeing you in San Diego this July!

 

Best wishes,
 
Dawn Wright, Esri Chief Scientist
Jack Dangermond, Esri President and CEO

 

RSVP for the Symposium at esriurl.com/rsvp

See this important blog post by Orhun Aydin of Esri's Spatial Statistics Team where he describes different means of integrating space into scientific problem solving, with an eye toward generic (non-spatial) machine learning, spatial machine learning, and non-spatial machine learning with geoenriched predictors.

 

The Science of Where in a Warming Planet: Spatial vs Non-Spatial Machine Learning

Esri Chief Scientist Dawn Wright  is an invited speaker for the 4D Workshop: Deep-time Data Driven Discovery and the Evolution of Earth

 

The 4-D Workshop will be convened June 4-6, 2018 in Washington DC with sponsorship by NASA, the USGS, the Gordon and Betty Moore Foundation, the Sloan Foundation, the Keck Foundation, the Earth Life Science Institute (Japan), the Carnegie Institution for Science, the Templeton Foundation, and others. 

 

The Senior Advisory Council for the event includes the current President of the National Academy of Sciences (Marcia McNutt), the former president of the National Science Foundation (Rita Colwell), the former corporate vice president of Microsoft (Tony Hey), Chief Data Officer of NOAA Ed Kearns, Director of Scripps Institution of Oceanography Margaret Leinen, Executive Director and CEO of the American Geophysical Union (AGU) Christine McEntee, Executive Director of the Federation of Earth Science Information Partners (ESIP) Erin Robinson.

  

The objective of the event is to “explore ways to advance our understanding of Earth’s complex co-evolving geosphere and biosphere through the collection, analysis, and visualization of large and growing data resources. It is a prelude to a potential long-term program to invent, modify, and apply emerging methods of data analysis and visualization to elucidate our planet’s past, present, and future. Earth’s evolution has been an intertwined succession of increasingly complex physical, chemical, and biological events. Therefore, 4D’s organizing principal is an integrated approach that will enable humankind to achieve a comprehensive picture of the co-evolution of life and rocks, while collaborating with research teams around the world.”

 

The workshop results will tie into the Keck- and Sloan-supported Deep-Time Data Infrastructure: (http://dtdi.carnegiescience.edu). 

 

Dawn Wright has been asked to speak at the first plenary session on the second day of the event, on "Artificial intelligence and machine learning for Earth surface data and conservation priorities" (with thanks to Omar Maher, David Gadsden, and Nathan Shephard for materials). She has also been asked to participate in and possibly chair breakout sessions, will be presenting a poster on Esri’s phase 2 of the  Ecological Marine Units, and may be contributing content to the Workshop's White Paper.

Esri and the National Science Foundation (NSF)-funded initiative known as EarthCube have today signed an informal Memorandum of Agreement (MOA). EarthCube was initiated by the NSF in 2011 to "transform geoscience research by developing cyberinfrastructure to improve access, sharing, visualization, and analysis of all forms of geosciences data and related resources." It is also a "quickly growing community of scientists across all geoscience domains, as well as geoinformatics researchers and data scientists."

 

As Esri Chief Scientist I have been pleased to serve on the EarthCube Liaison Team since 2014 and have built a "Mapping the Landscape" story map for the team which has been presented at several EarthCube-related meetings. We hope that this project will continue and merge with similar efforts at ESIP (Federation of Earth Science Information Partners), AGU (American Geophysical Union), and RDA (Research Data Alliance). The MOA was developed and signed by way of the Liaison Team and joint activities to be pursued include: 

 

  • mapping the larger geo/ cyberinfrastructure landscape and community (e.g., the story map) and further updating such a “landscape” map with organizations, initiatives, agencies, data facilities, etc., as well as assessing where EarthCube fits into this landscape;
  • semantic search, data mining-based metadata enrichment, persistent identifiers, geo-ontologies, and where possible, Linked Open Data;
  • more efficient access to data once found within searches, including the building of data publishing and geoprocessing services in the cloud to make data more accessible; and
  • removing barriers to data integration and interoperability, error and uncertainty of observations, spatial and temporal gaps in observations, and the related issues of user involvement and capacity building.

 

Toward this end, there will be the free exchange of emails, literature, computer code, and data where appropriate between Esri and the EarthCube community.

Esri Product Engineers/Data Scientists Shaun Walbridge, Noah Slocum, and Marjean Pobuda led the charge on a new peer-reviewed journal article about the open-source extension from Esri known as the Benthic Terrain Modeler (BTM). The paper describes the tools provided with the current release of BTM (v 3.0), highlighting powerful analytical workflows that combine ArcGIS with the Python scientific stack (aka SciPy), and the R statistical programming language (including the R-ArcGIS Bridge). BTM is used by scores of researchers around the world, and has been accessible for some time via ArcGIS Online at http://esriurl.com/btm (nearly 7500 views).

 

ABSTRACT:

High resolution remotely sensed bathymetric data is rapidly increasing in volume, but analyzing this data requires a mastery of a complex toolchain of disparate software, including computing derived measurements of the environment. Bathymetric gradients play a fundamental role in energy transport through the seascape. Benthic Terrain Modeler (BTM) uses bathymetric data to enable simple characterization of benthic biotic communities and geologic types, and produces a collection of key geomorphological variables known to affect marine ecosystems and processes. BTM has received continual improvements since its 2008 release; here we describe the tools and morphometrics BTM can produce, the research context which this enables, and we conclude with an example application using data from a protected reef in St. Croix, US Virgin Islands.

 

The paper is open access (#openscience) and part of a special issue on Marine Geomorphometry - http://www.mdpi.com/journal/geosciences/special_issues/marine_geomorphometry - featuring other studies that use GIS, including ArcGIS, as well.

WARNING: Last Jedi Spoiler Alert!

This is a re-posting of a blog piece by Lou Woodley, Community Engagement Specialist for AAAS's Trellis Science and Program Director of AAAS Community Engagement Fellows. I have posted it here because of the many helpful parallels to GeoNet.

 

5 things The Last Jedi reminds us about community management by Lou Woodley

 

1. Get to know – and work with – your biggest advocates

As any community manager knows, your community is made up of members with different personalities and activity levels. Your job is to create and maintain a space where they can work constructively together towards a common vision.

There’s been much criticism of Poe in The Last Jedi – the headstrong hero who’s so passionate about fighting for the rebellion that he’s prepared to be increasingly rash in his actions, whatever the cost. But most facilitators of well-established communities will recognise at least one Poe in their midst – the regular contributor who reliably dives in to every single one of the discussion threads, or who happily tells you and anyone else on the Internet who’ll listen how you’ve ruined everything with your latest product update/marketing campaign/editorial the minute it disappoints him.

Poe’s really a super-user out-of-control – someone who cares so much about the community that his actions ultimately become destructive and detrimental to it. While one response to this as a community manager is to regulate and respond after the fact via the enforcement of community guidelines, an alternative response is to attempt to head off the unconstructive behavior in the first place. Getting to know your super-users via check-ins, structured advocacy programs and other channels for regular feedback can help them to feel empowered but with their energy directed towards things of benefit to the overall community.

2. Communicate clearly and often with all of your community stakeholders – not just in times of crisis

One of the most desperate moments in The Last Jedi is towards the end when the rebels are hiding out in their formerly abandoned base, waiting to hear of any offers of help from outside allies – and not a single one comes.

A big danger for those running hosted communities is getting so engrossed in the day-to-day work with community members that they neglect to keep other stakeholders up-to-date about the community plans and progress.

Just because your senior management or funder is not yet regularly active in the community, don’t forget to keep them updated about how things are going with their investment. Maybe that requires educating them about community lifecycle models and what to expect over the coming months – rather than defensively attempting to justify why communities take time to flourish. Start that dialogue before you hit a crisis when you need money for a software upgrade or when community members are giving difficult feedback that needs a meaningful response.

Likewise, while you may be in the habit of celebrating your community members and their activities within your community, don’t forget to let the outside world know about the great work your community is doing too. This can be a source of new community members, as well as building reputation for your community within its niche, maintaining it as the place to be.

Depending on the community and your wider audience you might do this through a blog, periodic press releases and news stories, industry commentaries or social media.

3. Don’t get distracted by your origin stories – leadership should evolve

Origin stories are an important part of community culture – they create a shared narrative for the community, helping to initiate new members into what the community is for and reinforcing a sense of belonging for existing members. They can essentially be shorthand for some of your community values. But they can also become the target of embellishments and/or be deployed in service of an individual’s personal goals – resulting in the creation of cult hero figures within the community and a growing sense of disenfranchisement among members.

This is one of the themes The Last Jedi tackles in multiple places – from unpicking the heroic reputation of Luke Skywalker in Jedi history (and how that contrasts to his tortured reality following failure to successfully mentor Kylo Ren) to Rey exploring whether she really needs a “royal lineage” to be worthy of contributing as a Jedi.

Related to this, the initial founders and/or leaders of a community should never assume that they’re going to stay in that role forever. A healthy community thinks about succession early, and makes way for new inputs and new leadership to arise. The Last Jedi is a pivotal point in the history of the resistance because it sees the old leadership and hero figures – Luke, Leah (and to some extent the daredevil behaviour of characters such as Poe), moving aside or being pushed aside, to make way for a necessary rebirth.

4. Use your powers with kindness – and examine your motivations regularly

One of the most striking scenes in the Last Jedi is Kylo Ren ordering the slaughter of Luke Skywalker by directing all of the Empire’s firepower onto the lone figure standing unarmed in front of the rebel base. Looking increasingly maniacal, Ren is over-run by his hatred to destroy the person he sees as his greatest enemy, prompting even his colleague, Hux, to declare “Enough!”

We’ve all seen a variant of this online – discussions that rapidly escalate without any kindness where polarization of beliefs seemingly justifies inhumane behaviour. As community managers we have the ability to create spaces where we can influence the social norms in a variety of ways – from modeling good behaviour and rewarding constructive contributions to punishing bad behaviour by implementing the consequences of our community guidelines. It’s important at every stage to examine our own motivations to ensure that we’re behaving fairly and proportionately in our responses.

The related lesson in The Last Jedi is that breaking the community guidelines doesn’t always have to result in outright expulsion from the community (although of course, in some situations that is necessary). Sometimes deploying kindness and seeking cautious forgiveness and reintegration is an appropriate response to mistakes – something that has to be decided based on the circumstances and individuals involved.

For initially disobeying orders during a mission, Poe is demoted. But desperate and dissatisfied with new leader Holdo’s seeming lack of action, Poe then leads an outright mutiny. And yet, tellingly, the response of a recovered Leah and Holdo is to restrain and restrict Poe, without outright banishing him, knowing that he still brings something to the resistance. It’s going to be very interesting to see how his role as “difficult community member” evolves in the next Star Wars installment!

5. You don’t get to define the community’s vision alone – it gets co-created by community members

One of the ways we define a community is a group of people with a shared vision and thus shared sense of belonging. The key word here is shared. It’s not up to the community manager or their organisation or even a funder to define the ultimate vision for a community – it’s something that has to be evolved as a process between members of the community, including the community manager.

What this also allows is for members to step up or step back as their circumstances require, making for a fluid set of interactions. Different people have the capacity and desire to step up at different times – and different community members will be at different stages of commitment to the community and with slightly different interests. Can you create a space that’s flexible enough to accommodate that?

This is illustrated in The Last Jedi through the continual relighting and sharing of the beacon of hope throughout the film. Faced with impending failure, Finn loses all hope and attempts to flee in an escape pod – yet later in the film he’s the one championing the fight from the rebel base. Rey persists in persuading Luke to teach her about the Force, while at the same time confused and questioning its role in her life. Even fearless Leah loses hope at the lack of response to her call for help, then the crystal foxes point out a possible exit route.

No single character is responsible for the survival of the resistance – Poe doesn’t save them all in an act of heroic violence, Holdo’s plan for escape partially fails, Rey doesn’t dissuade Kylo from his plan, Leah doesn’t draw in any external allies, Luke doesn’t physically defeat Ren in a grand showdown… It’s their collective inputs and how they play off one another that ultimately move them towards a chance of survival – the incremental tick, tick, tick of progress rather than a single, grand gesture.

And to me that’s why the final scene with the boy wearing Rose’s ring with the rebel insignia is really about the role of community in the continuation of the rebellion and all it stands for – whatever its next iteration. Yes, the child is playing with a figure of Luke, but Luke’s role as a returned hero is just the visible face of a much bigger story that any community manager knows – your community is what it is because of the contributions of everyone in it.

In addition to supporting the science community, we seek to do good science at Esri ourselves, as it underpins much of what we stand for as an organization. This is helping us to evolve ArcGIS into a comprehensive geospatial platform FOR science; a platform that supports research project management and collaboration, spatial analysis, visualization, open data, and communication of science, and all at multiple scales (i.e., from individual researcher to lab workgroup, to multi-department, multi-university, university-to-agency collaboration, to citizen engagement). This an exciting time at Esri as things are moving so quickly that it is hard to keep up with all the many pathways of our science initiative.

 

For instance, DID YOU KNOW, that you could run ArcGIS for free on a supercomputer? Indeed, if you want run something really big (e.g., vector-based geoanalytics, raster analytics, geoevent processing), there IS now a place where you can do this at no cost, and you can run as many ArcGIS processes as you want for free. The place is XSEDE (eXtreme Science and Engineering Discovery Environment), the NSF-funded collection of research supercomputer centers in the US. Their hardware includes supercomputers running special OS and middleware, as well as large windows clusters for cloud configuration, including JetStream, which has over 15,000 cores and 80Tb of RAM. Esri and XSEDE have recently collaborated to set up ArcGIS Enterprise with big data extensions within a Jupyter sandbox where XSEDE users can easily play and get started. For those wanting to run more specific or larger projects, they will also be able to configure and manage their own cluster. For more information about this opportunity, contact Eric Shook at the University of Minnesota, eshook@umn.edu  Professor Shook is GIS domain lead for XSEDE and can help you better understand XSEDE qualification requirements and how to apply for an allocation.

 

See also this Overview of Esri Cloud and Big Data Spatial Analytics Offerings Available to XSDEDE.

 

DID YOU KNOW that ArcGIS now supports planetary science? We now provide support the Planetary Data System Version 3 Format and the ISIS Data Cube format.  We also support the coordinate systems for all planets, known named satellites, and dwarf planets in our solar system. This includes the Mars 2000 Sphere, which is critical for the Mars Rovers. Both ArcGIS Desktop and Server tier tools work for these other bodies, just as they do for Earth.

      This March we upgraded our Javascript 3.x API so that the measure widget in the Portal/ArcGIS Online map viewer respects the correct planetary coordinate system and planetary body size. That team continues to evolve this for the 4.x API for 3D as well. Our Runtime Core Geometry Engines do not support Planetary Coordinate Systems yet, but we are working toward enhancing them in 2018 to do so. In addition, in next week’s Runtime Update 2, the Local Server will be based off of the 10.5.1 code base and support analysis on the Local Server and Map Packages in all Planetary, Satellite, and Dwarf Planet Coordinate Systems.  

 

There is now a publicly-shared Planetary Sciences Group with example web maps and story maps within the new Sciences Portal on ArcGIS Online. See also To Infinity and Beyond: ArcGIS Now Supports Extraterrestrial Mapping.

 

DID YOU KNOW that Esri is getting better all the time at fully supporting data in 3D, including LiDAR data? This includes our improved support for vertical aerial LiDAR curtain data in KML.  We are also working toward supporting multidimensional data in vertical curtain form, aka L2 or 3d fence or Swath. See our 3D fences tool in action in this video and this story map, with a full write up and examples in this ArcUser article, and with code that is also available on ArcGIS Code Sharing. In fact, DID YOU KNOW that there IS such a site as ArcGIS Code Sharing now?! 

 

DID YOU KNOW that Esri has a new initiative in Artificial Intelligence and Machine Learning? We now have "GeoAI" resources and demos on GitHub, and a recent blog post on possible machine learning implementations in ArcGIS. See also The Science of Where Seagrasses Grow: ArcGIS and Machine Learning.

 

DID YOU KNOW about Esri's new partnership with Microsoft in the realm of Artificial Intelligence and about the Esri technology now within Microsoft's Data Science Virtual Machine (i.e., ArcGIS Pro and the R-ArcGIS Bridge)? DID YOU KNOW that you can apply for cloud computing grants under this initiative? The next deadline is fast approaching at 15 December, but will be additional grant cycles in 2018. This is part of Microsoft's exciting new AI for Earth Initiative which may become "a game-changer for our planet." DID YOU ALSO KNOW about the Research AI for Earth European Union Oceans Award?  Submit by 15 February 2018.

 

DID YOU KNOW about the Image Analyst Extension for ArcGIS Pro 2.1 Beta1 Release? The Image Analyst Extension is now available in ArcGIS Pro 2.1 Beta1. This is a controlled Beta which is not part of the ArcGIS Pro 2.1 Early Adopter Program. However, it can be accessed through a separate Early Adopter Program focused on the Image Analyst extension. Try it out, review the resources and provide feedback for the functional areas of interest to you within the extension, including stereo and image space visualization, mensuration, feature extraction/interpretation and image classification. Please direct any questions or concerns to Vinay Viswambharan vinayv@esri.com.

 

DID YOU KNOW about these online imagery resources?

 

DID YOU FURTHER KNOW that:

  • the ArcGIS API for Python is easy to learn and extremely useful for scientists, including data scientists? One of the features that makes this API so powerful is its integration with the Jupyter Notebook.
  • our Hydrology Toolset in ArcGIS Pro has been parallelized in Raster Analytics at ArcGIS 10.6?
  • the R-ArcGIS Bridge now has raster support in beta?
  • Esri released our first beta Docker containerization support with this summer’s 10.5.1 release of ArcGIS Enterprise and that we’re continuing to look at containers moving forward? See CloudFormation templates to deploy ArcGIS Enterprise on Amazon Web Services and/or AWS CloudFormation and ArcGIS—ArcGIS Enterprise on AWS | ArcGIS Enterprise.
  • Esri recently added support for the SMAP (10.5.0), GPM (10.5.1), GOES-R (10.6, both ABI and GLM sensors, and ASTER L1T (10.6) platforms over the last year in an effort to better support our remote sensing users? Here are some instructions from the National Snow and Ice Data Center on working with SMAP data in ArcGIS.
  • the Esri LandSat Explorer app’s code was open-sourced this week? This is one of our many #imagery items on that GitHub site for code sharing.
  • Esri has detailed our philosophy of and commitment to "Open" at our Esri’s Open Vision site? Many are familiar  with the closed, limited-interoperability ESRI products of the past, but we are ever moving forward. DID YOU KNOW that as a company, we are currently leveraging and contributing to over 200 open-source projects, while delivering over 350 open-source projects of our own? Esri software provides direct read, import, and export for over 300 formats, including over 200 image formats and sensors. Esri supports over 100 geospatial standards (including those from ISO TC 211 and OGC), and provides open access to scores of APIs and SDKs.

 

IT'S GOOD TO BE IN-THE-KNOW! 

 

 

 

 

Thanks to Tripp Corbett, Steve Kopp, and Peter Eredics for providing much of the information for this post.

We are pleased to share the lineup of oral talks and posters that will be presented this December at the 2017 American Geophysical Union (AGU) Fall Meeting in San Francisco. Many know of AGU as among the world’s most well-respected Earth science scholarly organizations, and its annual fall meeting dwarfs our UC by over 10,000 attendees. AGU 2017 expects 24,000 attendees, making it the largest Earth and space science meeting in the world.

 

You’ll see in the list below of papers, posters and sessions that Esri is leading or contributing on a wide variety of interesting and important projects, many with our federal partners at NASA, NOAA, and the USGS, as well as several universities. This showcases how we are an organization that not only enables great understanding of the world with our products and services, but also performs good science, and contributes well as a member of the scientific community, sharing and inspiring others as to The Science of Where. In addition, we will have a 20' x 20' exhibit booth presence, #1125 ( beside the AGU and NOAA booths, shared with the QPS booth, led by Research & Sciences Industry Manager Drew Stephens and staffed full-time by ArcGIS Content Lead Sean Breyer, and Spatial Statistics Product Engineer Kevin Butler) with messaging and demos on multidimensional scientific data and analysis, imagery, big data geoanalytics, The Living Atlas, ArcGIS Pro, Ecological Land Units, Ecological Marine Units, GeoPlanner, Insights, story maps, the web GIS pattern, our commitment to open/interoperable, and more.

 

All in all, we are sending ~15 Esri staff  to participate at AGU, and are so pleased again to be sharing our exhibit booth space with representatives of our long-standing business partner, QPS. 

 

AGU PRESENTATIONS and SESSIONS with Esri Participation

(where G = Geodesy, H = Hydrology, IN = Earth and Space Science Informatics, P = Planetary Sciences)

 

G11C-0714:  International Digital Elevation Model Service (IDEMS): A Revived IAG Service

 

H13O-06:  The CAnadian Surface Prediction ARchive (CaSPAr): A Platform to Enhance Environmental Modelling in Canada and Globally

 

IN23B co-convened by Esri's Sudhir Shrestha: Architecture and Test Bed for Earth/Space Science Cyberinfrastructures I Posters

 

IN23E co-convened by Esri's Sudhir Shrestha: Architecture and Test Bed for Earth/Space Science Cyberinfrastructures  II

 

IN24A-03:  Automating Geospatial Visualizations with Smart Default Renderers for Data Exploration Web Applications

 

IN31B-0077:  Predicting Seagrass Occurrence in a Changing Climate Using Random Forests

 

IN33E convened by Esri's Sudhir Shrestha: Spatial Data Infrastructure for Earth and Space Sciences: Analyzing, Visualizing, and Sharing Spatiotemporal Earth Science Data Small and Big II

 

IN33E-08:  Near Real-time Scientific Data Analysis and Visualization with the ArcGIS Platform

 

IN41B convened by Esri's Sudhir Shrestha: Spatial Data Infrastructure for Earth and Space Sciences: Analyzing, Visualizing, and Sharing Spatiotemporal Earth Science Data Small and Big I Posters

 

IN51H-03:  Recommended GIS Analysis Methods for Global Gridded Population Data

 

P33E-2913:  Spatial Data Infrastructures (SDIs): Improving the Scientific Environmental Data Management and Visualization with ArcGIS Platform (Invited)

 

View and search the entire AGU Fall Meeting Program at https://agu.confex.com/agu/fm17/meetingapp.cgi/Home/0

Check out the new Sciences Portal in ArcGIS Online at http://science.maps.arcgis.com/home/index.html with some nice introductory material about it already posted by Joseph Kerski

 

And in support of the Group on Earth Observations (GEO) Week and the GEO-XIV Plenary, 23-27 October 2017 in Washington, DC, Esri offer Insights for a Changing World: The Complete Platform for Earth Observation with an assortment of links to spatially intelligent scientific apps and additional landing pages.

Did you know that the fall season can be ALMOST as busy as pre-UC for Esri staff in terms of important science conferences? Here is the road ahead from my perspective.

 

October 17-19 – It will be great to have the Esri Health and Human Services GIS Conference here in Redlands this year, where Jack himself will speak, as well as Director of Sales Chris Cappelli, our own Chief Medical Officer Dr. Este Geraghty, spatial stats queen Lauren Bennett and spatial epidemiologist Dr. Linda Beale (of Insights fame). They will be joined by a host of distinguished plenary speakers including the COO of Kaiser Permanente and the Chief Medical Officer of Inland Empire Health Plan. Science-of-Where approaches toward stemming the opioid epidemic are sure to be among the many important timely and topics.

 

October 31-November 2 – The Esri Ocean GIS Forum here in Redlands moves into its fifth offering and is on track for its largest attendance ever. It has become more than just a small esoteric, specialist meeting. It is in fact a very important community-building event cutting horizontally across many business sectors, especially national govt, state/local govt, natural resources, nonprofit, education, defense. And did you know that it is often at the FORUM that new tech is demoed or introduced even BEFORE the Dev Summit or UC (e.g., dry run of VR/AR, launch of the SciPy Stack, advancements in multidimensional sci analysis, etc.). This year’s keynote will be given by former astronaut & NOAA administrator Kathryn Sullivan. And we will again be honored by Chris Cappelli’s plenary participation.

 

November 7-10ACM SIGSPATIAL in Redondo Beach. Esri plays a large and significant role in ACM SIGSPATIAL, one of the best academic conferences directly relating to key topics being addressed by Esri software development. Esri is a corporate sponsor for this event along with Google, Lyft, Facebook, Oracle, nVidia, Microsoft, IBM, and Ordnance Survey). With Esri's Erik Hoel at the helm as conference co-chair, Esri Dev staff serve as conference officers and members of the program committee. And Esri Dev staff have had two full papers accepted for presentation and publication (one on spatio-temporal join in Apache Spark and one on a new utility-centric graph information model). This is quite an achievement given the highly selective 17% acceptance rate (~40 papers out of ~230 were accepted). Esri had 2 of the top 7 ranked papers by numerical evaluation score!

 

November 9-10Imagery Education Summit here in Redlands - This one-time-only, invitation-only event will host 75-100 remote sensing/imagery faculty members from top universities across the country to discuss Esri’s technical advancements in imagery, drive platform adoption at these top universities and help them transform their imagery curricula. Conceived and convened by Imagery Director Lawrie Jordan, and co-sponsored by NASA and Oak Ridge National Lab.

 

December 11-15 – American Geophysical (AGU) Fall Meeting in New Orleans. AGU is the world largest, more pre-eminent Earth science conference. It dwarfs our UC with an annual attendance of over 25,000. AGU is a meeting that we not only serve as exhibitors, but co-organize sessions with scientists, present papers and posters, participate in science communication and career/education workshops. Dan Rather is speaking at this year’s event. In the past, keynoters have included Elon Musk and Al Gore.

 

A few weeks ago, Esri released an update to the ArcGIS API for Python. The newest release includes:

Hopefully, you can tell that the new functionality in the API that I am most excited about is the spatial dataframe! The spatial dataframe extends the pandas dataframe by adding geometry, spatial reference, and other spatial components to the dataframe. In adding the spatial dataframe to the API, ArcGIS users can now read feature classes, feature services, and image services directly into a dataframe. Once in a spatial dataframe, users can perform fast statistical and spatial analysis on the dataupdate existing feature services, and convert the dataframe to a feature class or shapefile. These are just a few examples of how you can use the spatial dataframe.

What really interests me is how this can be used with an ArcGIS image service. Can I use the spatial dataframe to extract image footprints from an image service? Can I use it to perform statistical analysis image footprints over a specific part of the world?

The answer to both of these questions is Yes! In this post, I’ll walk through how to use the API for Python to extract image service footprints from the Landsat 8 Views image service, show how to use a spatial filter to extract only footprints over New Jersey, determine the mean cloud cover and most recent acquisition date of the images, and share those image footprints as a feature service. If you have ever been interested in doing any of these, check out my post on gavinr.com!