elixir - %HTTPoison.Error{id: nil, reason: :closed} -


we using httpoison in our code base post , requests while using hackney pool. posting here because want opinions experts.

we working lot of cameras, where, each camera, getting images, , images, saving them to seaweedfs servers.

we making thousand of request on per second range. on seaweedfs side, have initiated servers timeout of 10 seconds. , on our code base side, uploading image using hackney configuration.

  :hackney_pool.child_spec(:seaweedfs_upload_pool, [timeout: 5000, max_connections: 1000]),   :hackney_pool.child_spec(:seaweedfs_download_pool, [timeout: 5000, max_connections: 1000]), 

for last few days, having issue in this. @ first, timeout , max_connections on our side 10 secs , 5k. , started getting httpoison errors as

{%httpoison.error{id: nil, reason: :closed}} 

the errors count high 12k , on, time being, after discussing in elixir slack channel changed timeout , max_connections above settings. after this, errors reduced 3k 12k 2 or 3 days, after error count again going 12k , on.

the person developed seaweedfs, pointed library using send http requests not closing connections, , on our seaweedfs server side(the server our code base send requests reading , write) result of command is

root@ubuntu-1404-trusty-64-minimal ~ # netstat | grep http | wc -l 5086 

can suggest me something? reason of error?

i have done few discussions on elixir slack channel , come know, hackney pool, if making post request timeout of 5 seconds , http request returned success within 2 or 3 seconds connection made request remain open other 2 seconds(completing 5 seconds) that, still open connection used other http post request? maybe wrong in theory.

but nice if point me better solutions hackney pool.

we using httpoison 0.11.1 using hackney 1.7.1.


Comments

Popular posts from this blog

javascript - Clear button on addentry page doesn't work -

c# - Selenium Authentication Popup preventing driver close or quit -

tensorflow when input_data MNIST_data , zlib.error: Error -3 while decompressing: invalid block type -