Custom Metadata Checks: Creating An XSD File?

[PeterCurry]

Hello Fellow GIS Pros,

I am needing to know how to create an XSD (metadata schema) file, which is what you need to order to run a custom metadata check in Data Reviewer.

I may need to create this XSD file and run a custom check -- in the case that the metadata themes that are checked when telling Data Reviewr to run against either of the two FGDC metadata standards -- does not cover parts of the metadata we need checked.

How do I create an XSD file?  More specifically, how is this XSD file designed so as to only include those metadata parts/themes we need checked when running a custom metadata check in Data Reviewer?

Can this XSD file be created/modified from another standard template -- or not?

Step-by-step instructions would be great.  Or if you can point me to a resource that clearly outlines the process, I would appreciate it.

Thank you!

[JayCary]

Hi Peter,

For clarification, which FGDC standard are you using to validate metadata content?

In the case of the FGDC's CSDGM, schema-based validation can be carried-out using either a document type definition (http://www.fgdc.gov/metadata/fgdc-std-001-1998.dtd) or an XML schema document (http://www.fgdc.gov/metadata/fgdc-std-001-1998.xsd).  Schema validation using Data Reviewer's Metadata check is based on a standard's XSD.

Also, what are the metadata elements that are not currently being evaluated and how do you need to evaluate them?

For example, will these elements be evaluated based on their naming/structure/data type or are there element value rules that need to implemented.  This will help determine whether you need to go through the effort of creating a custom XSD or if you can leverage custom XPATH expressions in the Metadata check.

Thanks

[PeterCurry]

Hello Jay,

Thanks so much for your response.  You are the only one that has responded so far.  I don't know -- is it that the metadata check in Data Reviewer is still that new (having just been released with 10.0) -- that people are just not interested in this discussion because they don't really know enough yet about the metadata check?

So there are two options for validating metadata against an FGDC standard when setting up the metadata check in Data Reviewer.  You can use "FGDC Metadata 1.0" or "FGDC CSDGM".  I'm not quite sure which one it is -- and not really familiar with the difference between the two.  What is the difference?

We are using the FGDC standard that requires seven sections to be filled out: "Identification", "Data Quality", "Spatial Data Organization", "Spatial Reference", "Entities and Attributes", "Metadata Reference", and "Distribution Information".  So whichever of the two standard mentioned above -- this scenario applies to ... (?)

Can you describe a little bit more about what a "document type definition" is?  I also see that you provided the link to the XSD file for FGDC CSDGM.  Is there also an XSD in existence for FGDC Metadata 1.0?  If so, where do I obtain the XSD file for FGDC Metadata 1.0?

Basically, first -- we need to make sure that all seven sections (mentioned above) are probably filled out?  I know for a fact that the metadata check will tell you if a section is incomplete -- listing it in the results table by metadata "element". 

I don't know exactly what metadata elements is being checked -- when you run it against FGDC Metadata 1.0 or FGDC CSDGM.  How do you figure this out?  And is there a way to control what FGDC metadata elements are being checked -- when running the check against one of the two standards?

Second -- we may very well need to check to see if certain text is included in various sections of the metadata.  This is where the XPATH expressions come in, correct?  And are XPATH expressions like a whole other language -- or is it like SQL statements?

Thanks again 🙂
Peter

[JayCary]

Peter,

It sounds like you need to verify that certain sections of the FGDC standard are being populated and in some cases you need to verify that elements are populated with specific information.

If that is the case, I would recommend implementing a series of content validation expressions using the Metadata check's "Validate Metadata Content" check option.  This check option will enable you to identify whether a metadata element has been populated (using the IsNull Pre-Defined Expression) or contains specific content (using a Custom Expression).

The "Validate Metadata Content" check option is discussed in detail in the Data Reviewer blog article entitled "Did you know you can automate metadata validation (part 2)?" with examples provided of its use.

To determine which elements to check, you may want to leverage the recommendation outlined in the "Tips and Tricks" section of the article regarding methods for determining element XPATH names.  This section proposes a workflow for identifying a metadata element's name by using the ArcGIS Metadata Editor to populate a metadata template with "dummy" values.  The metadata template is then exported using the Esri Metadata Translator GP tool to an XML file where a 3rd-party XML viewer can be used to look-up FGDC element's name.

[ATTACH=CONFIG]17578[/ATTACH]

Good luck with configuring the check.

[KatieMcHugh1]

Hi there,

I wanted to expand on this older topic, and ask specifically how  can verify a chunk of text in my metadata. I have a section of text,several sentences long, that should be present in the Use Constraints section of my metadata. At this time I am using ESRI  format but I will also need to check FGDC. I have a custom check set up and it reads as follows (only the actual text is several sentences long):
/metadata/idinfo/useconst  [(. = "These data are provided by ...xxyyzz...")]

When I verify, the message says that "The expression was verified correctly."  However, when I run the check, it comes back with no errors, even when I have altered the text, so I know there are errors. I want the check to throw an error if anything between "  "  is not exactly as it is shown in the check.

Is there something extra I need to do, to indicate that I am checking for exact text?

Thanks so much!
katie

[BarbaraWoolf2]

I am having the same problem as Katie.  All my metadata comes back with no errors even when I know there are errors in the metadata.  I have tried the Pre-Defined expression where I choose "is Null" and then select a lot of metadata elements that I know are empty, Add the Expression, and then in the Reviewer Batch Job Manager I validate the checks. 

I have also tried the Custom expression without any success, even though when I click on verify, the message says that "The expression was verified correctly." 

Any suggestions on what would cause this and how to correct it?  I am using the Data Reviewer Extension's Metadata Check in ArcGIS 10.1.
Thanks, Barbara

[KumarBhardwaj]

Hi Barbara,

I request you to please contact Esri Support for this issue. We might have to request you for a small sample of your data for further trouble shooting.

Please refer to the following link to conatct Esri Support:

http://support.esri.com

Thanks,
Kumar