topic Re: Can Python be used to find duplicate datasets? in Python Questions https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633531#M49362 <HTML><HEAD></HEAD><BODY><P>depends on what you are comparing, but it is part of the standard module in all versions of python</P><P></P><P><A class="link-titled" href="https://docs.python.org/3/library/filecmp.html" title="https://docs.python.org/3/library/filecmp.html">filecmp — File and Directory Comparisons — Python 3.8.3 documentation</A>&nbsp;</P><P></P><P>moved to <A href="https://community.esri.com/space/2145">Python</A>‌</P></BODY></HTML> Thu, 21 May 2020 22:09:51 GMT DanPatterson 2020-05-21T22:09:51Z Can Python be used to find duplicate datasets? https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633530#M49361 <HTML><HEAD></HEAD><BODY><P><SPAN>Can Python be used to compare datasets?&nbsp; We have 2 directories stuffed with datasets. I need to sort thru the directories to determine which dataset is a stand-alone vs. a duplicate in a 2nd directories. Any ideas on how to go about this?</SPAN></P></BODY></HTML> Thu, 21 May 2020 19:57:49 GMT https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633530#M49361 GailMorrison 2020-05-21T19:57:49Z Re: Can Python be used to find duplicate datasets? https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633531#M49362 <HTML><HEAD></HEAD><BODY><P>depends on what you are comparing, but it is part of the standard module in all versions of python</P><P></P><P><A class="link-titled" href="https://docs.python.org/3/library/filecmp.html" title="https://docs.python.org/3/library/filecmp.html">filecmp — File and Directory Comparisons — Python 3.8.3 documentation</A>&nbsp;</P><P></P><P>moved to <A href="https://community.esri.com/space/2145">Python</A>‌</P></BODY></HTML> Thu, 21 May 2020 22:09:51 GMT https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633531#M49362 DanPatterson 2020-05-21T22:09:51Z Re: Can Python be used to find duplicate datasets? https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633532#M49363 <HTML><HEAD></HEAD><BODY><P><EM><STRONG style="background-color: #ffffff; ">We have 2 directories stuffed with datasets.</STRONG></EM></P><P></P><P><SPAN style="background-color: #ffffff;">What is <EM>your</EM> definition of dataset in this context?&nbsp; Are these shape files?&nbsp; Are they feature classes within geodatabases?&nbsp; When you say duplicates do you mean the same name?</SPAN></P></BODY></HTML> Thu, 21 May 2020 23:06:08 GMT https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633532#M49363 JoeBorgione 2020-05-21T23:06:08Z Re: Can Python be used to find duplicate datasets? https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633533#M49364 <HTML><HEAD></HEAD><BODY><P>As Joe suggests, it could get real difficult if you have multiple data types and aren't familiar with coding (using arcpy.da.Walk) and several of the tools in this toolset</P><P><A class="link-titled" href="https://pro.arcgis.com/en/pro-app/tool-reference/data-management/an-overview-of-the-data-comparison-toolset.htm" title="https://pro.arcgis.com/en/pro-app/tool-reference/data-management/an-overview-of-the-data-comparison-toolset.htm">An overview of the Data Comparison toolset—Data Management toolbox | Documentation</A>&nbsp;</P></BODY></HTML> Thu, 21 May 2020 23:43:16 GMT https://community.esri.com/t5/python-questions/can-python-be-used-to-find-duplicate-datasets/m-p/633533#M49364 DanPatterson 2020-05-21T23:43:16Z