[jira] [Commented] (DISPATCH-1986) [http1] system_tests_http1_adaptor failure due to Address already in use issue

[Ganesh Murthy (Jira)]

    [ https://issues.apache.org/jira/browse/DISPATCH-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293796#comment-17293796 ]

Jiri Daněk commented on DISPATCH-1986:
--------------------------------------

https://travis-ci.com/github/apache/qpid-dispatch/jobs/487443865#L5213

{noformat}
test 68
      Start 68: system_tests_http1_adaptor
68: Test command: /usr/bin/python "/home/travis/build/apache/qpid-dispatch/build/tests/run.py" "-m" "unittest" "-v" "system_tests_http1_adaptor"
68: Test timeout computed to be: 600
68: test_01_unsolicited_response (system_tests_http1_adaptor.Http1AdaptorBadEndpointsTest) ... ok
68: test_02_bad_request_message (system_tests_http1_adaptor.Http1AdaptorBadEndpointsTest) ... ok
68: test_03_bad_response_message (system_tests_http1_adaptor.Http1AdaptorBadEndpointsTest) ... ok
68: test_01_concurrent_requests (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest) ... Exception in thread Thread-28:
68: Traceback (most recent call last):
68:   File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
68:     self.run()
68:   File "/usr/lib/python2.7/threading.py", line 754, in run
68:     self.__target(*self.__args, **self.__kwargs)
68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 328, in _run
68:     rsp = client.getresponse()
68:   File "/usr/lib/python2.7/httplib.py", line 1182, in getresponse
68:     response.begin()
68:   File "/usr/lib/python2.7/httplib.py", line 467, in begin
68:     version, status, reason = self._read_status()
68:   File "/usr/lib/python2.7/httplib.py", line 423, in _read_status
68:     line = self.fp.readline(_MAXLINE + 1)
68:   File "/usr/lib/python2.7/socket.py", line 480, in readline
68:     data = self._sock.recv(self._rbufsize)
68: timeout: timed out
68:
68: TestClient: 485be7f538834cedb5f8b1ad8462699b
68: 2021-03-02 12:51:37.622377 TestClient connecting on 127.0.0.1:26978
68: 2021-03-02 12:51:37.622395 TestClient connected
68: 2021-03-02 12:51:37.622402 TestClient start request 0
68: 2021-03-02 12:51:37.622409 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:37.624194 TestClient getting POST response
68: 2021-03-02 12:51:38.285861 TestClient response POST received
68: 2021-03-02 12:51:38.285903 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:38.285910 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:38.286084 TestClient getting GET response
68: 2021-03-02 12:51:38.351320 TestClient response GET received
68: 2021-03-02 12:51:38.352906 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:38.352916 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:38.353092 TestClient getting GET response
68: 2021-03-02 12:51:38.474365 TestClient response GET received
68: 2021-03-02 12:51:38.529523 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:38.529536 TestClient start request 1
68: 2021-03-02 12:51:38.529542 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:38.529844 TestClient getting POST response
68: 2021-03-02 12:51:38.694263 TestClient response POST received
68: 2021-03-02 12:51:38.694323 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:38.694329 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:38.694452 TestClient getting GET response
68: 2021-03-02 12:51:38.803325 TestClient response GET received
68: 2021-03-02 12:51:38.808890 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:38.808901 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:38.809090 TestClient getting GET response
68: 2021-03-02 12:51:39.031646 TestClient response GET received
68: 2021-03-02 12:51:39.157720 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:39.157738 TestClient start request 2
68: 2021-03-02 12:51:39.157746 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:39.158082 TestClient getting POST response
68: 2021-03-02 12:51:39.331940 TestClient response POST received
68: 2021-03-02 12:51:39.332017 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:39.332053 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:39.332239 TestClient getting GET response
68: 2021-03-02 12:51:39.489083 TestClient response GET received
68: 2021-03-02 12:51:39.491620 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:39.491629 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:39.491789 TestClient getting GET response
68: 2021-03-02 12:51:39.571381 TestClient response GET received
68: 2021-03-02 12:51:39.605070 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:39.605086 TestClient start request 3
68: 2021-03-02 12:51:39.605094 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:39.605415 TestClient getting POST response
68: 2021-03-02 12:51:39.926892 TestClient response POST received
68: 2021-03-02 12:51:39.926977 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:39.926986 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:39.927215 TestClient getting GET response
68: 2021-03-02 12:51:40.052133 TestClient response GET received
68: 2021-03-02 12:51:40.079010 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:40.079022 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:40.079205 TestClient getting GET response
68: 2021-03-02 12:51:40.300175 TestClient response GET received
68: 2021-03-02 12:51:40.385088 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:40.385107 TestClient start request 4
68: 2021-03-02 12:51:40.385115 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:40.385443 TestClient getting POST response
68: 2021-03-02 12:51:40.669671 TestClient response POST received
68: 2021-03-02 12:51:40.669774 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:40.669785 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:40.670011 TestClient getting GET response
68: 2021-03-02 12:51:40.843575 TestClient response GET received
68: 2021-03-02 12:51:40.843656 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:40.843664 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:40.843888 TestClient getting GET response
68: 2021-03-02 12:51:41.074281 TestClient response GET received
68: 2021-03-02 12:51:41.106483 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:41.106500 TestClient start request 5
68: 2021-03-02 12:51:41.106508 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:41.106821 TestClient getting POST response
68: 2021-03-02 12:51:41.370015 TestClient response POST received
68: 2021-03-02 12:51:41.370093 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:41.370102 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:41.370301 TestClient getting GET response
68: 2021-03-02 12:51:41.547836 TestClient response GET received
68: 2021-03-02 12:51:41.547918 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:41.547927 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:41.548165 TestClient getting GET response
68: 2021-03-02 12:51:41.732306 TestClient response GET received
68: 2021-03-02 12:51:41.757400 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:41.757418 TestClient start request 6
68: 2021-03-02 12:51:41.757425 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:41.757781 TestClient getting POST response
68: 2021-03-02 12:51:42.017111 TestClient response POST received
68: 2021-03-02 12:51:42.017229 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:42.017240 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:42.017468 TestClient getting GET response
68: 2021-03-02 12:51:42.151899 TestClient response GET received
68: 2021-03-02 12:51:42.153872 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:42.153884 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:42.154088 TestClient getting GET response
68: 2021-03-02 12:51:42.286325 TestClient response GET received
68: 2021-03-02 12:51:42.344098 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:42.344128 TestClient start request 7
68: 2021-03-02 12:51:42.344138 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:42.344526 TestClient getting POST response
68: 2021-03-02 12:51:42.715565 TestClient response POST received
68: 2021-03-02 12:51:42.715667 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:42.715677 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:42.715885 TestClient getting GET response
68: 2021-03-02 12:51:42.865754 TestClient response GET received
68: 2021-03-02 12:51:42.865824 TestClient request GET /GET/test_01_concurrent_requests_10_small completed!
68: 2021-03-02 12:51:42.865832 TestClient sending GET /GET/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:42.866010 TestClient getting GET response
68: 2021-03-02 12:51:43.045797 TestClient response GET received
68: 2021-03-02 12:51:43.115951 TestClient request GET /GET/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:43.115968 TestClient start request 8
68: 2021-03-02 12:51:43.115978 TestClient sending POST /POST/test_01_concurrent_requests_10 request
68: 2021-03-02 12:51:43.116375 TestClient getting POST response
68: 2021-03-02 12:51:43.366774 TestClient response POST received
68: 2021-03-02 12:51:43.366874 TestClient request POST /POST/test_01_concurrent_requests_10 completed!
68: 2021-03-02 12:51:43.366885 TestClient sending GET /GET/test_01_concurrent_requests_10_small request
68: 2021-03-02 12:51:43.367117 TestClient getting GET response
68: 2021-03-02 12:52:43.462909 TestClient 127.0.0.1:26978 shut down
68: FAIL
68: test_02_credit_replenish (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest) ... ERROR
68: test_03_server_reconnect (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest) ... ERROR
68: test_04_server_pining_for_the_fjords (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest) ... ERROR
68: test_05_large_streaming_msg (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest) ... ERROR
68:
68: Router EA2 debug dump file:
68: >>>>
68: alloc.c: Items of type 'qd_timer_t' remain allocated at shutdown: 1 (SUPPRESSED)
68: alloc.c: Items of type 'qd_buffer_t' remain allocated at shutdown: 32 (SUPPRESSED)
68: alloc.c: Items of type 'qd_connector_t' remain allocated at shutdown: 1 (SUPPRESSED)
68:
68: <<<<
68:
68: Router EA1 debug dump file:
68: >>>>
68: alloc.c: Items of type 'qd_timer_t' remain allocated at shutdown: 1 (SUPPRESSED)
68: alloc.c: Items of type 'qd_buffer_t' remain allocated at shutdown: 16 (SUPPRESSED)
68: alloc.c: Items of type 'qd_connector_t' remain allocated at shutdown: 1 (SUPPRESSED)
68:
68: <<<<
{noformat}

> [http1] system_tests_http1_adaptor failure due to Address already in use issue
> ------------------------------------------------------------------------------
>
>                 Key: DISPATCH-1986
>                 URL: https://issues.apache.org/jira/browse/DISPATCH-1986
>             Project: Qpid Dispatch
>          Issue Type: Bug
>          Components: Protocol Adaptors
>    Affects Versions: 1.15.0
>            Reporter: Ganesh Murthy
>            Assignee: Ken Giusti
>            Priority: Major
>
> {noformat}
> 68: test_01_mgmt (system_tests_http1_adaptor.Http1AdaptorManagementTest) ... ok
> 68: test_000_stats (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_001_get (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_002_head (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_003_post (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_004_put (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_005_get_10 (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ERROR
> 68: test_006_head_10 (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_007_post_10 (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68: test_008_put_10 (system_tests_http1_adaptor.Http1AdaptorOneRouterTest) ... ok
> 68:
> 68: Router INT.A debug dump file:
> 68: >>>>
> 68: alloc.c: Items of type 'qd_buffer_t' remain allocated at shutdown: 16 (SUPPRESSED)
> 68:
> 68: <<<<
> 68: test_01_backpressure_client (system_tests_http1_adaptor.Http1AdaptorQ2Standalone) ... ok
> 68: test_02_backpressure_server (system_tests_http1_adaptor.Http1AdaptorQ2Standalone) ... ok
> 68:
> 68: ======================================================================
> 68: ERROR: test_02_credit_replenish (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 1238, in test_02_credit_replenish
> 68:     tests=TESTS)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 256, in __init__
> 68:     tests)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 234, in __init__
> 68:     HTTPServer.__init__(self, addr, handler_cls)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 417, in __init__
> 68:     self.server_bind()
> 68:   File "/usr/lib/python2.7/BaseHTTPServer.py", line 108, in server_bind
> 68:     SocketServer.TCPServer.server_bind(self)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 431, in server_bind
> 68:     self.socket.bind(self.server_address)
> 68:   File "/usr/lib/python2.7/socket.py", line 228, in meth
> 68:     return getattr(self._sock,name)(*args)
> 68: error: [Errno 98] Address already in use
> 68:
> 68: ======================================================================
> 68: ERROR: test_03_server_reconnect (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 1270, in test_03_server_reconnect
> 68:     tests=TESTS)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 256, in __init__
> 68:     tests)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 234, in __init__
> 68:     HTTPServer.__init__(self, addr, handler_cls)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 417, in __init__
> 68:     self.server_bind()
> 68:   File "/usr/lib/python2.7/BaseHTTPServer.py", line 108, in server_bind
> 68:     SocketServer.TCPServer.server_bind(self)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 431, in server_bind
> 68:     self.socket.bind(self.server_address)
> 68:   File "/usr/lib/python2.7/socket.py", line 228, in meth
> 68:     return getattr(self._sock,name)(*args)
> 68: error: [Errno 98] Address already in use
> 68:
> 68: ======================================================================
> 68: ERROR: test_04_server_pining_for_the_fjords (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 1321, in test_04_server_pining_for_the_fjords
> 68:     tests=TESTS)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 256, in __init__
> 68:     tests)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 234, in __init__
> 68:     HTTPServer.__init__(self, addr, handler_cls)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 417, in __init__
> 68:     self.server_bind()
> 68:   File "/usr/lib/python2.7/BaseHTTPServer.py", line 108, in server_bind
> 68:     SocketServer.TCPServer.server_bind(self)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 431, in server_bind
> 68:     self.socket.bind(self.server_address)
> 68:   File "/usr/lib/python2.7/socket.py", line 228, in meth
> 68:     return getattr(self._sock,name)(*args)
> 68: error: [Errno 98] Address already in use
> 68:
> 68: ======================================================================
> 68: ERROR: test_05_large_streaming_msg (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 1428, in test_05_large_streaming_msg
> 68:     tests=TESTS_11)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 256, in __init__
> 68:     tests)
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 234, in __init__
> 68:     HTTPServer.__init__(self, addr, handler_cls)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 417, in __init__
> 68:     self.server_bind()
> 68:   File "/usr/lib/python2.7/BaseHTTPServer.py", line 108, in server_bind
> 68:     SocketServer.TCPServer.server_bind(self)
> 68:   File "/usr/lib/python2.7/SocketServer.py", line 431, in server_bind
> 68:     self.socket.bind(self.server_address)
> 68:   File "/usr/lib/python2.7/socket.py", line 228, in meth
> 68:     return getattr(self._sock,name)(*args)
> 68: error: [Errno 98] Address already in use
> 68:
> 68: ======================================================================
> 68: ERROR: test_005_get_10 (system_tests_http1_adaptor.Http1AdaptorOneRouterTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 956, in test_005_get_10
> 68:     self._do_request(client, self.TESTS_10["GET"])
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 920, in _do_request
> 68:     rsp = client.getresponse()
> 68:   File "/usr/lib/python2.7/httplib.py", line 1182, in getresponse
> 68:     response.begin()
> 68:   File "/usr/lib/python2.7/httplib.py", line 467, in begin
> 68:     version, status, reason = self._read_status()
> 68:   File "/usr/lib/python2.7/httplib.py", line 423, in _read_status
> 68:     line = self.fp.readline(_MAXLINE + 1)
> 68:   File "/usr/lib/python2.7/socket.py", line 480, in readline
> 68:     data = self._sock.recv(self._rbufsize)
> 68: timeout: timed out
> 68:
> 68: ======================================================================
> 68: FAIL: test_01_concurrent_requests (system_tests_http1_adaptor.Http1AdaptorEdge2EdgeTest)
> 68: ----------------------------------------------------------------------
> 68: Traceback (most recent call last):
> 68:   File "/home/travis/build/apache/qpid-dispatch/tests/system_tests_http1_adaptor.py", line 1206, in test_01_concurrent_requests
> 68:     self.assertEqual(repeat_ct * REQ_CT, client.count)
> 68: AssertionError: 30 != 25 {noformat}

--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]