Collector App Sync - SEVERE ERROR.

[BledarBirbo1]

HI i have been investigating this for 3 days but haven't been able to find a solution.

We have published 2 Feature Services on our own ArcGIS Server 10.2.2

We have a Web Adapter 10.2.2 in front of the ArcGIS Server. (HTTPS)

We have created a Map on AGOL

The users are in the field collecting data offline and taking photos as attachments with the iOS Collector 10.3

During our tests and for some users in the beginning there were no syncing issues at all.

The problem is now that all the users are now reporting " illegal start of token (<) " and cannot sync their work back to the server.

a-) On Arcgis Server (DEBUG Logs) we are getting the following ERROR:

com.esri.rf.RException: Error parsing multi-part request at 
com.esri.rf.multipart.DefaultMultipartRequestHandler.parseRequest(DefaultMultipartRequestHandler.java:72) at 
com.esri.rf.RFactory.newMultipartRequestHandler(RFactory.java:203) at 
com.esri.rf.RRequest.newInstance(RRequest.java:976) at 
com.esri.rf.RServlet.service(RServlet.java:86) at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:728) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222) at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123) at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502) at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171) at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100) at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408) at 
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1041) at 
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:603) at 
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310) at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at 
java.lang.Thread.run(Thread.java:744) 
Caused by: org.apache.commons.fileupload.FileUploadException: Read timed out at org.apache.commons.fileupload.FileUploadBase.parseRequest(FileUploadBase.java:381) at 
org.apache.commons.fileupload.servlet.ServletFileUpload.parseRequest(ServletFileUpload.java:126) at 
com.esri.rf.multipart.DefaultMultipartRequestHandler.parseRequest(DefaultMultipartRequestHandler.java:65) ... 19 
more Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:152) at java.net.SocketInputStream.read(SocketInputStream.java:122) at sun.security.ssl.InputRecord.readFully(InputRecord.java:442) at sun.security.ssl.InputRecord.read(InputRecord.java:480) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927) at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884) at sun.security.ssl.AppInputStream.read(AppInputStream.java:102) at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:532) at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501) at org.apache.coyote.http11.InternalInputBuffer$InputStreamInputBuffer.doRead(InternalInputBuffer.java:563) at org.apache.coyote.http11.filters.IdentityInputFilter.doRead(IdentityInputFilter.java:124) at org.apache.coyote.http11.AbstractInputBuffer.doRead(AbstractInputBuffer.java:346) at org.apache.coyote.Request.doRead(Request.java:422) at org.apache.catalina.connector.InputBuffer.realReadBytes(InputBuffer.java:290) at org.apache.tomcat.util.buf.ByteChunk.substract(ByteChunk.java:449) at org.apache.catalina.connector.InputBuffer.read(InputBuffer.java:315) at org.apache.catalina.connector.CoyoteInputStream.read(CoyoteInputStream.java:200) at org.apache.commons.fileupload.MultipartStream$ItemInputStream.makeAvailable(MultipartStream.java:977) at org.apache.commons.fileupload.MultipartStream$ItemInputStream.read(MultipartStream.java:887) at java.io.InputStream.read(InputStream.java:101) at org.apache.commons.fileupload.util.Streams.copy(Streams.java:94) at org.apache.commons.fileupload.util.Streams.copy(Streams.java:64) at org.apache.commons.fileupload.MultipartStream.readBodyData(MultipartStream.java:593) at org.apache.commons.fileupload.MultipartStream.discardBodyData(MultipartStream.java:619) at org.apache.commons.fileupload.MultipartStream.skipPreamble(MultipartStream.java:638) at org.apache.commons.fileupload.FileUploadBase$FileItemIteratorImpl.findNextItem(FileUploadBase.java:961) at org.apache.commons.fileupload.FileUploadBase$FileItemIteratorImpl.<init>(FileUploadBase.java:942) at org.apache.commons.fileupload.FileUploadBase.getItemIterator(FileUploadBase.java:331) at org.apache.commons.fileupload.FileUploadBase.parseRequest(FileUploadBase.java:349) ... 21 more 

b-) On Arcgis Server (DEBUG Logs) we are also getting "Unable to process request. Error parsing multi-part request" as a high level error.

c-) Here are the IIS logs from the Web-Adpator site. (Please note that although some ports made it to the arcgis server the last upload part is failing with code 500)

2015-05-07 07:09:36 141.xxx.xxx.xxx POST /server/tokens/ f=json 443 - 82.148.xxx.xxx Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 2979
2015-05-07 07:09:44 141.xxx.xxx.xxx POST /server/rest/services/TEAM2100/Collector_Active_Assets/FeatureServer/uploads/register - 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 920
2015-05-07 07:09:44 141.xxx.xxx.xxx POST /server/rest/services/TEAM2100/Collector_Active_Assets_Redline/FeatureServer/synchronizeReplica - 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 8002
2015-05-07 07:09:46 141.xxx.xxx.xxx GET /server/rest/services/TEAM2100/Collector_Active_Assets_Redline/FeatureServer/jobs/jaa5f0db584ea4053acbdd6ef428390d5 f=json&token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 1419
2015-05-07 07:09:54 141.xxx.xxx.xxx GET /server/rest/services/TEAM2100/Collector_Active_Assets_Redline/FeatureServer/jobs/jaa5f0db584ea4053acbdd6ef428390d5 f=json&token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 967
2015-05-07 07:10:01 141.xxx.xxx.xxx GET /server/rest/services/TEAM2100/Collector_Active_Assets_Redline/FeatureServer/jobs/jaa5f0db584ea4053acbdd6ef428390d5 f=json&token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 1872
2015-05-07 07:10:45 141.xxx.xxx.xxx POST /server/rest/services/TEAM2100/Collector_Active_Assets/FeatureServer/uploads/i8aa3ef1e-fec4-48b2-bc9f-5d697178d051/uploadPart token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 60824
2015-05-07 07:11:56 141.xxx.xxx.xxx POST /server/rest/services/TEAM2100/Collector_Active_Assets/FeatureServer/uploads/i8aa3ef1e-fec4-48b2-bc9f-5d697178d051/uploadPart token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 200 0 0 71292
2015-05-07 07:13:01 141.xxx.xxx.xxx POST /server/rest/services/TEAM2100/Collector_Active_Assets/FeatureServer/uploads/i8aa3ef1e-fec4-48b2-bc9f-5d697178d051/uploadPart token=C3-2a7tyzySX4nq1NMOsL2Y2j89rGiXmR68hT7bnOuyr6I9UrafswZP6WmLcbERz 443 - 82.148.44.205 Collector-iOS-10.3:ArcGISiOS-10.2.4+Collector/8.1.2/iPad5,4 500 0 0 64225
#Software: Microsoft Internet Information Services 7.5

Things we have tried  with no success :

NIM099731 - The error message, "Error parsing multi-part reque..

Re: Sync error: Illegal start of token [&lt;]

Any ideas on why this happens ?

Thanks

[AdrianMarsden]

Some more testing and a single feature work no attachments syncs, a single feature with a single photo worked. But a single feature with 9 photos failed. I'll try numbers between 1 and 9 later.

Also, on full debug, the server shows a huge java message just at the same time as the SRVERE error thrown on the sync.

So is there a java memory setting that needs increasing?