CCTV Manager está disponível agora! Obtenha as últimas novidades do ArcGIS Solutions for Water<\/A>.<\/SPAN><\/PRE><\/P>Ao longo dos anos, recebemos muitos feedbacks excelentes sobre a solução CCTV Processor<\/A>. Se você não está familiarizado com esta solução, ela é uma ferramenta de geoprocessamento para ArcMap que importa dados de inspeções de vídeo de esgoto por circuito fechado no padrão NASSCO PACP versão 6. As tabelas de Inspeções e Condições são convertidas em pontos para cada observação e linhas para o principal pesquisado. As imagens ou fotos das observações também são carregadas como anexos, facilitando a publicação dos dados como um serviço e permitindo que qualquer pessoa em sua organização acesse os dados do CCTV. Esta solução simplesmente desbloqueia a riqueza de informações capturadas durante as pesquisas CCTV.<\/SPAN><\/P><\/P>Devido a solicitações dos usuários para suportar outros tipos de importação e o novo PACP v7, sabíamos que era hora de aprimorar o CCTV Processor.<\/SPAN><\/P><\/P>1:<\/STRONG><\/SPAN> Migrar do Model Builder para uma Python Toolbox: <\/STRONG><\/SPAN>O Model Builder é ótimo para definir um processo complexo, nós construímos uma ferramenta mais rápida, fácil de usar e mais estável usando uma <\/SPAN>Python Toolbox<\/A>. <\/P><\/P><\/P>2: Projetado para ArcGIS Pro:<\/STRONG><\/SPAN> Para suportar a próxima Utility Network além dos dados representados em uma Geometric Network, migramos o CCTV Processor para ArcGIS Pro. Isso também nos permitiu simplificar o código, tornando-o mais rápido e confiável.<\/SPAN><\/P> <\/SPAN><\/P>3: Resolução do BUG-000104129:<\/STRONG><\/SPAN> A ferramenta atual funciona muito bem para pontos de observação em um tubo a partir de múltiplas pesquisas, mas tínhamos um problema difícil de corrigir na versão atual. Se um tubo fosse pesquisado mais de uma vez, criávamos apenas um segmento de linha de inspeção. A nova versão resolveu esse bug.<\/SPAN><\/P> <\/SPAN><\/P>4: Suporte para múltiplos esquemas de entrada:<\/STRONG><\/SPAN> a atualização nos permite suportar mais do que apenas dados da versão PACP v6.0.4. Agora você tem a opção de selecionar PACP v6.0.4, PACP v7.0.7 e Custom. Selecionar qualquer uma das opções PACP preencherá automaticamente o restante dos parâmetros da ferramenta. Se você selecionar Custom, precisará mapear esses parâmetros para sua entrada. Agora há uma opção para adicionar esquemas adicionais à lista de opções. Detalharemos esse processo no lançamento ou se quiser tentar, poste um comentário e forneceremos instruções.<\/SPAN><\/P><\/P><\/P><\/P><\/P>Esperamos que goste da nova versão. Esta é apenas a primeira prévia. ainda não migramos todos os recursos, como mensagens ou conversão de links. <\/SPAN><\/P> <\/SPAN><\/P>Também estamos procurando alguns dos seus dados CCTV para testar. if você tiver uma exportação PACP v7 ou outro esquema e não se importar em compartilhá-la conosco, adoraríamos testá-la para garantir que tudo esteja 100% funcional.<\/SPAN><\/P><\/P><\/P>Começando com CCTV no Pro<\/STRONG>Algumas instalações são necessárias:<\ /SPAN></ P >< P >< SPAN >1 . <\ / SPAN >< A href = "https : \/ \/www.microsoft.com\ /en-US\ /download\ /details.aspx?id=13255 " rel = "nofollow noopener noreferrer" target = "_blank" > Microsoft Access Database Engine 2010 Redistributable <\ / A ><\ / P >< UL style = "padding-left : 60px ; " >< LI >Como ArcGIS Pro é um aplicativo de 64 bits, certifique-se de escolher a versão x64.<\ / LI >< LI >< IMG __jive_id = "357275" class = "image-3 jive-image" src = "https : \/ \/us.v-cdn.net\ /6038851\ /uploads\ /legacyfs\ /online\ /357275_pastedImage_2.png " style = "width : 620px ; height : 378px ; " \/ ><\ / LI ><\ / UL >< P >2 . pyodbc<\ / P >< UL >< LI >Você pode instalar facilmente via Python Package Manager <\ / A >.<\ / LI >< LI >< IMG __jive_id = "357276" class = "jive-image image-4" src = "https : \/ \/us.v-cdn.net\ /6038851\ /uploads\ /legacyfs\ /online\ /357276_pastedImage_3.png " style = "width : 620px ; height : 395px ; " \/ ><\ / LI >< LI >Se o ArcGIS Pro estiver travando após a instalação, veja este post GeoNet <\ / A > para um guia sobre como corrigir o problema.<\ / LI >< LI >A imagem mostra a versão 3.0.10. a versão PYODBC 4 também é suportada. a versão 4.0.17 foi testada no RC2.<\ / LI ><\ / UL >< P ><\ / P >< P ><\ / P >< P >Mike &amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;& Paul<\ / P >< P >ArcGIS for Utilities<\ / P ><\ / BODY ><\ / HTML >
<\/P>
Ao longo dos anos, recebemos muitos feedbacks excelentes sobre a solução
Devido a solicitações dos usuários para suportar outros tipos de importação e o novo PACP v7, sabíamos que era hora de aprimorar o CCTV Processor.<\/SPAN><\/P><\/P>1:<\/STRONG><\/SPAN> Migrar do Model Builder para uma Python Toolbox: <\/STRONG><\/SPAN>O Model Builder é ótimo para definir um processo complexo, nós construímos uma ferramenta mais rápida, fácil de usar e mais estável usando uma <\/SPAN>
2: Projetado para ArcGIS Pro:<\/STRONG><\/SPAN> Para suportar a próxima Utility Network além dos dados representados em uma Geometric Network, migramos o CCTV Processor para ArcGIS Pro. Isso também nos permitiu simplificar o código, tornando-o mais rápido e confiável.<\/SPAN><\/P> <\/SPAN><\/P>3: Resolução do BUG-000104129:<\/STRONG><\/SPAN> A ferramenta atual funciona muito bem para pontos de observação em um tubo a partir de múltiplas pesquisas, mas tínhamos um problema difícil de corrigir na versão atual. Se um tubo fosse pesquisado mais de uma vez, criávamos apenas um segmento de linha de inspeção. A nova versão resolveu esse bug.<\/SPAN><\/P> <\/SPAN><\/P>4: Suporte para múltiplos esquemas de entrada:<\/STRONG><\/SPAN> a atualização nos permite suportar mais do que apenas dados da versão PACP v6.0.4. Agora você tem a opção de selecionar PACP v6.0.4, PACP v7.0.7 e Custom. Selecionar qualquer uma das opções PACP preencherá automaticamente o restante dos parâmetros da ferramenta. Se você selecionar Custom, precisará mapear esses parâmetros para sua entrada. Agora há uma opção para adicionar esquemas adicionais à lista de opções. Detalharemos esse processo no lançamento ou se quiser tentar, poste um comentário e forneceremos instruções.<\/SPAN><\/P><\/P><\/P><\/P><\/P>Esperamos que goste da nova versão. Esta é apenas a primeira prévia. ainda não migramos todos os recursos, como mensagens ou conversão de links. <\/SPAN><\/P> <\/SPAN><\/P>Também estamos procurando alguns dos seus dados CCTV para testar. if você tiver uma exportação PACP v7 ou outro esquema e não se importar em compartilhá-la conosco, adoraríamos testá-la para garantir que tudo esteja 100% funcional.<\/SPAN><\/P><\/P><\/P>Começando com CCTV no Pro<\/STRONG>
Algumas instalações são necessárias:<\ /SPAN></ P >< P >< SPAN >1 . <\ / SPAN >< A href = "https : \/ \/www.microsoft.com\ /en-US\ /download\ /details.aspx?id=13255 " rel = "nofollow noopener noreferrer" target = "_blank" > Microsoft Access Database Engine 2010 Redistributable <\ / A ><\ / P >< UL style = "padding-left : 60px ; " >< LI >Como ArcGIS Pro é um aplicativo de 64 bits, certifique-se de escolher a versão x64.<\ / LI >< LI >< IMG __jive_id = "357275" class = "image-3 jive-image" src = "https : \/ \/us.v-cdn.net\ /6038851\ /uploads\ /legacyfs\ /online\ /357275_pastedImage_2.png " style = "width : 620px ; height : 378px ; " \/ ><\ / LI ><\ / UL >< P >2 . pyodbc<\ / P >< UL >< LI >Você pode instalar facilmente via
You will need a machine that has the 64 driver installed so you can create the fgdb from the access files. I was able to get 64 bit access driver on my machine with 32 bit office by first installing the 64 bit driver and then office.
I have noticed the CCTV Processor is being replaced with CCTV Manager. The 64-bit Microsoft Access Database Engine is now a requirement for these tools to work. Will ESRI still provide a workaround for those of us who are still running the 32-bit version?
We're using the latest beta processor to convert multiple clients historic data from an old Access database system into a GIS system. All of our clients have converted over successfully except for one, and we are getting the following error when we try to run their data through the processor. Any help would be greatly appreciated!
Start Time: Monday, June 25, 2018 5:37:09 PMRunning script CreateConditionPoints...17:37:09 Saving results to C:\Users\mfacer\Documents\ArcGIS\Projects\VersaillesCCTV\CCTVResults3.gdb17:37:12 Loading 3,138 records from CONDITIONS table17:37:13 Loading 243 records from INSPECTIONS table17:37:16 Loading 3,142 records from MEDIA_CONDITIONS table17:37:16 Loading 243 records from MEDIA_INSPECTIONS table17:37:17 Splitting lines17:37:17 Locating conditions Traceback (most recent call last): File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\common.py", line 399, in _asarray_tuplesafe result[:] = valuesValueError: could not broadcast input array from shape (0,2) into shape (0)
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\frame.py", line 2564, in _ensure_valid_index value = Series(value) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\series.py", line 264, in __init__ raise_cast_failure=True) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\series.py", line 3277, in _sanitize_array subarr = _asarray_tuplesafe(data, dtype=dtype) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\common.py", line 402, in _asarray_tuplesafe result[:] = [tuple(x) for x in values]ValueError: cannot copy sequence with size 2 to array axis with dimension 0
Traceback (most recent call last): File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W_Preview_RC2\CCTVProcessorA4W\Maps and GDBs\cctv\gptools.py", line 455, in execute image_name=abstract.media_condition_image) File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W_Preview_RC2\CCTVProcessorA4W\Maps and GDBs\cctv\gptools.py", line 411, in run points, lines = p.save_to_disk(target_gdb=gdb) File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W_Preview_RC2\CCTVProcessorA4W\Maps and GDBs\cctv\core.py", line 467, in save_to_disk df = self.process() File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W_Preview_RC2\CCTVProcessorA4W\Maps and GDBs\cctv\core.py", line 423, in process df[self.inspection_point] = df[[self.pipe_shape, 'percent']].apply(lambda f: self._locate_point(*f), axis=1) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\frame.py", line 2519, in __setitem__ self._set_item(key, value) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\frame.py", line 2584, in _set_item self._ensure_valid_index(value) File "C:\Program Files\ArcGIS\Pro\bin\Python\envs\arcgispro-py3\lib\site-packages\pandas\core\frame.py", line 2566, in _ensure_valid_index raise ValueError('Cannot set a frame with no defined index 'ValueError: Cannot set a frame with no defined index and a value that cannot be converted to a Series Failed to execute (CreateConditionPoints).Failed at Monday, June 25, 2018 5:37:17 PM (Elapsed Time: 8.35 seconds)
I'm working on a version that will read the CCTV data from a file geodatabase. There will be a separate tool (which still requires pyodbc), to convert Access to FGDB.
I am running into the same issue as Tristan because my version of Office is 32bit. Is there any way to get this new version of CCTV Processor to work for those of us who can't install the 64bit version of Office?
Thanks everyone for the feedback so far! We've just uploaded a new beta version with the following enhancements and fixes:
We're also investigating an import of MACP inspections. If you have any MACP data that you can share, please let us know. We're also interested in any version 7 data (PACP or MACP).
You can email to pleblanc@esri.com or mmiller@esri.com
sorted([None, ''])
gives that error message. As you noted, pandas will insert NaN (which is similar to None). The simple fix is to filter None out before sorting inside the create_sql function.
I'm curious what configuration of the data will get into this state.
Your error is saying TypeError: '<' not supported between instances of 'NoneType' and 'str', look if that value shows up anywhere in your data, the "<". Also looks for any strings in a number field or numbers in a string field. Otherwise it sounds like an problem with either the create_sql function which I assuming is writing a SQL clause as a string before passing to an sqlParser but something how the string is created is messed up. The tool usings python pandas. In pandas the object type does not necessarily mean dtype str. and pandas forces the type to change when it inserts NaN values so this could be happening here. However I'm mostly just speculating as I did not deep dive into debugging it
Hmm, I'd need to look at the data. Can you provide your pipes feature class and access database? You can email to pleblanc@esri.com
Paul, I do not see any empty values in the tables, specifically in the ConditionID field. Any other assistance would be greatly appreciated.
There's probably an empty value in one of the access tables. I think this might be be ConditionID field.
I am getting the following error when running this tool and would greatly appreciate any help in solving this problem:
Running script CreateConditionPoints... Traceback (most recent call last): File "<string>", line 438, in execute File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W\Maps and GDBs\cctv\cctv.py", line 230, in __init__ self._check_dtypes() File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W\Maps and GDBs\cctv\cctv.py", line 236, in _check_dtypes pipe_pk = self.pipe[self.pipe_pk].dtype File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W\Maps and GDBs\cctv\cctv.py", line 280, in pipe sql = create_sql(self._pipe_table, self.pipe_pk, self.inspection[self.inspection_fk].tolist()) File "C:\Users\mfacer\Documents\ArcGIS\Projects\PennHillsCCTV\CCTVProcessorA4W\Maps and GDBs\cctv\cctv.py", line 37, in create_sql values = sorted(set(values))TypeError: '<' not supported between instances of 'NoneType' and 'str' Failed to execute (CreateConditionPoints).
Tristan, would it be possible for you to share you data with us? You can email to pleblanc@esri.com
What version of Office do you have installed? I have x86 Office 365, and I can install and use x64 Access driver without issue.
I have Microsoft Office Suite 32bit and Access 32bit installed. If I try to install the Microsoft Access Database Engine 2010 Redistributable(64bit) I get an error "You cannot install the 64-bit version of Microsoft Access Database Engine 2010 because you currently have 32-bit Office Products installed"
If I force the install using the /passive command prompt command it "installs" however when try to run the CCTV processor I get the following error, "Unable to load odbcji32.dll"
If I remove Office and Access and then install Microsoft Access Database Engine 2010 (64bit) the CCTV processor works but I don't have Office suite or Access now.
If I attempt to reinstall Office and Access 32bit, I get the following error "You cannot install the 32-bit version of Microsoft Office Suite because you currently have 64-bit Microsoft Access Database Engine 2010 installed"
This is a bit of a Catch 22
Is there a correct installation practice for Office 32bit and Access 32bit along with getting the CCTV processor to work other than installing the 64bit version of Office?
[UPDATE]
- I was able to get it to work alongside Office only by installing the 64bit version of Office and Access. This is not ideal.
- I was able to run the processor (PCAP 6.04 Schema) however the results were incorrect only 146 conditions came through out of an expected 6431.
- I was able to run it with the old CCTV processor and the results were as expected 6431.
- Not really sure what wrong with the new CCTV processor,
For example:Using the Old CCTV processor, I have a pipe with ID 4082. It has three separate inspections on it (95, 96, 403) and a total of 87 conditions.
Using the new one, it only has 3 conditions one for each pipe inspection (95,96, 403) and that's it, everything else is missing.
So for this year's CCTV going to use the Old CCTV Processor and hopefully next year the new one works correctly.
[UPDATE 2 - 28/11/2017]
- So it appears installing the 64bit version of office causes some additional headaches when using ArcGIS 10.3.1 and trying to load Excel tables into ArcMap.
- It gives you the following error: "Connect: Failed to connect to database. An underlying database error occurred. Class not registered."
- You can read more about this problem here: .XLSX PROBLEM - Failed to Connect to Database - Class Not Registered
- Easiest solution was to save the excel file as ".xls"
The goal is to have it updated and release for ArcGIS Pro 2.1 in January. You can start with the Beta and update when the release version is available. The end results will be very similar.
I'm looking to set this up for the first time, should I just wait until its official released as an update and ArcGIS Pro integrated? CCTV Processor | ArcGIS for Water
Any idea how much longer?
Thx
That solved the problem. I just needed to modify the table names in the original survey database. Thank you very much Paul!!!
Does your sample database match the PACP schema? It's looking for 'inspections' and your PACP database table is called 'pacp_inspections'.
You can either rename your table to be 'inspections' (case doesn't matter) or modify the schema to use your table name of 'pacp_inspections'
CCTVProcessorA4W\Maps and GDBs\cctv\schema\PACP v6.0.4\schema.xml
Ok yea that fixed the initial error. I should have caught that but thank you Paul!
I'm running into another error though. Sorry, I'm not sure how to look through the script and debug it myself. I think there is any issue with the save_to_disk function. Not sure why I'm getting this error with my own database and not the sample.
Start Time: Monday, September 11, 2017 10:23:31 AMRunning script CreateConditionPoints...Traceback (most recent call last): File "<string>", line 442, in execute File "C:\_MyTools\CCTVProcessorA4W_Preview_RC1\CCTVProcessorA4W\Maps and GDBs\cctv\cctv.py", line 433, in save_to_disk target=table_names[self._inspection_table.lower()])KeyError: 'pacp_inspections'Failed to execute (CreateConditionPoints).Failed at Monday, September 11, 2017 10:23:34 AM (Elapsed Time: 3.59 seconds)
Steven,
Are you using a PACP v7 schema? The code is incorrectly guessing that 'Direction' is the Inspections ID field. If you change that 'InspectionID' or similar, it should work.
Can someone please help me out? I'm trying to use the tool and keep getting this error:
I tried using the sample data and it worked. I've compared the field types in my PACP Database with the sample data and they are identical. Is there something I'm missing??
That library is required to use the tool. That is why you are getting the !
Python toolbox is not loading for me. I talked with my IT Dept about downloading that Access Database Engine x 64-bit because I am thinking this is my issue. They informed me not to do this as we are running 32 bit. Is there a work around for this? I cannot tell if I am experiencing another issue since I am unable to download the 64 bit Access Database Engine.
Thanks!
At the moment, only an access database is support as an input type. Is your data in an Access Format? If so, select custom and then fill out the parameters. As for how to get a custom item in the drop down, we have not typed those instructions up.
Paul93
... I'm expecting instructions for the Custom format (I saw it ask for Access database, but by default the data are in XML) now ..
Great, at least we have some nice troubleshooting steps logged for the next person. Thanks!
Finally! I really don't know what was it. Actually I download it again, extract it, open ArcGIS Pro ... didn't work, then remove it and add it again and ...BOOM!
One other thought, this PYT requires the cctv folder, all the logic is in there, the pyt is just a shell that loads from there. Can you make sure the folder structure looks like this?
* Mine is not loading as I do not have ODBC install
Can you make sure the PYT is valid, can you download it again. If right clicking will not let you edit it, something else is going on. Let me download it also to ensure it did not get corrupted
same
Membros conectados podem postar, seguir atualizações e mais. Novo aqui? Registre uma conta gratuita.
Find useful guides, FAQs, and documents to help you navigate and make the most of Esri Community.