Details
-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.4.0
-
Fix Version/s: None
-
Component/s: Server
-
Labels:None
Description
Increase the fs.s3a.connection.maximum can resolve the connection timeout, however sometimes for very larger table, it may get Read timeout:
S3AInputStream.java:162] Got timeout while trying to read from stream, trying to recover java.net.SocketTimeoutException: Read timed out
Right now it is not a blocker, as MR / spark job have retry policy, and the job will succeed finally.