elixir - %HTTPoison.Error{id: nil, reason: :closed} -
we using httpoison in our code base post , requests while using hackney pool. posting here because want opinions experts.
we working lot of cameras, where, each camera, getting images, , images, saving them to seaweedfs servers.
we making thousand of request on per second range. on seaweedfs side, have initiated servers timeout of 10 seconds. , on our code base side, uploading image using hackney configuration.
:hackney_pool.child_spec(:seaweedfs_upload_pool, [timeout: 5000, max_connections: 1000]), :hackney_pool.child_spec(:seaweedfs_download_pool, [timeout: 5000, max_connections: 1000]),
for last few days, having issue in this. @ first, timeout , max_connections on our side 10 secs , 5k. , started getting httpoison errors as
{%httpoison.error{id: nil, reason: :closed}}
the errors count high 12k , on, time being, after discussing in elixir slack channel changed timeout , max_connections above settings. after this, errors reduced 3k 12k 2 or 3 days, after error count again going 12k , on.
the person developed seaweedfs, pointed library using send http requests not closing connections, , on our seaweedfs server side(the server our code base send requests reading , write) result of command is
root@ubuntu-1404-trusty-64-minimal ~ # netstat | grep http | wc -l 5086
can suggest me something? reason of error?
i have done few discussions on elixir slack channel , come know, hackney pool, if making post request timeout of 5 seconds , http request returned success within 2 or 3 seconds connection made request remain open other 2 seconds(completing 5 seconds) that, still open connection used other http post request? maybe wrong in theory.
but nice if point me better solutions hackney pool.
we using httpoison 0.11.1 using hackney 1.7.1.
Comments
Post a Comment