We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug Windows 命令提示下,运行python3 run.py 命令会重复启动。
Environments (please complete the following information):
Additional context 日志记录如下,在11:13:07就已经启动了三个进程,为何在11:13:12左右又开始启动? ` 2023-03-09 11:13:07.871 | INFO | main:run:100 - starting proxypool... 2023-03-09 11:13:07.872 | INFO | main:run:104 - starting tester, pid None... 2023-03-09 11:13:07.881 | INFO | main:run:110 - starting getter, pid None... 2023-03-09 11:13:07.887 | INFO | main:run:116 - starting server, pid None... 2023-03-09 11:13:10.113 | DEBUG | mp_main:run_tester:33 - tester loop 0 start... 2023-03-09 11:13:10.114 | INFO | proxypool.processors.tester:run:74 - stating tester... 2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:76 - 13628 proxies to test 2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:79 - testing proxies use cursor 0, count 200 2023-03-09 11:13:10.164 | DEBUG | proxypool.processors.tester:test:42 - testing 185.66.59.4:42647 2023-03-09 11:13:10.186 | DEBUG | proxypool.processors.tester:test:42 - testing 220.179.210.239:8089 2023-03-09 11:13:10.187 | DEBUG | proxypool.processors.tester:test:42 - testing 203.223.171.185:4145 2023-03-09 11:13:10.335 | DEBUG | mp_main:run_getter:48 - getter loop 0 start... 2023-03-09 11:13:12.610 | INFO | main:run:100 - starting proxypool... 2023-03-09 11:13:12.611 | INFO | main:run:104 - starting tester, pid None... 2023-03-09 11:13:12.612 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 183.164.245.134:8089 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.617 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 35.174.204.39:9999 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.619 | INFO | main:run:110 - starting getter, pid None... 2023-03-09 11:13:12.621 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 91.249.134.148:80 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.626 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 82.98.147.36:80 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.628 | INFO | proxypool.storages.redis:decrease:84 - 203.28.8.252:80 score decrease 1, current 2.0 2023-03-09 11:13:12.628 | DEBUG | proxypool.processors.tester:test:65 - proxy 203.28.8.252:80 is invalid, decrease score 2023-03-09 11:13:12.631 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 27.157.228.206:8089 from http://www.66ip.cn/3.html 2023-03-09 11:13:12.632 | INFO | main:run:116 - starting server, pid None...
The text was updated successfully, but these errors were encountered:
Germey
No branches or pull requests
Describe the bug
Windows 命令提示下,运行python3 run.py 命令会重复启动。
Environments (please complete the following information):
Additional context
日志记录如下,在11:13:07就已经启动了三个进程,为何在11:13:12左右又开始启动?
`
2023-03-09 11:13:07.871 | INFO | main:run:100 - starting proxypool...
2023-03-09 11:13:07.872 | INFO | main:run:104 - starting tester, pid None...
2023-03-09 11:13:07.881 | INFO | main:run:110 - starting getter, pid None...
2023-03-09 11:13:07.887 | INFO | main:run:116 - starting server, pid None...
2023-03-09 11:13:10.113 | DEBUG | mp_main:run_tester:33 - tester loop 0 start...
2023-03-09 11:13:10.114 | INFO | proxypool.processors.tester:run:74 - stating tester...
2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:76 - 13628 proxies to test
2023-03-09 11:13:10.143 | DEBUG | proxypool.processors.tester:run:79 - testing proxies use cursor 0, count 200
2023-03-09 11:13:10.164 | DEBUG | proxypool.processors.tester:test:42 - testing 185.66.59.4:42647
2023-03-09 11:13:10.186 | DEBUG | proxypool.processors.tester:test:42 - testing 220.179.210.239:8089
2023-03-09 11:13:10.187 | DEBUG | proxypool.processors.tester:test:42 - testing 203.223.171.185:4145
2023-03-09 11:13:10.335 | DEBUG | mp_main:run_getter:48 - getter loop 0 start...
2023-03-09 11:13:12.610 | INFO | main:run:100 - starting proxypool...
2023-03-09 11:13:12.611 | INFO | main:run:104 - starting tester, pid None...
2023-03-09 11:13:12.612 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 183.164.245.134:8089 from http://www.66ip.cn/3.html
2023-03-09 11:13:12.617 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 35.174.204.39:9999 from http://www.66ip.cn/3.html
2023-03-09 11:13:12.619 | INFO | main:run:110 - starting getter, pid None...
2023-03-09 11:13:12.621 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 91.249.134.148:80 from http://www.66ip.cn/3.html
2023-03-09 11:13:12.626 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 82.98.147.36:80 from http://www.66ip.cn/3.html
2023-03-09 11:13:12.628 | INFO | proxypool.storages.redis:decrease:84 - 203.28.8.252:80 score decrease 1, current 2.0
2023-03-09 11:13:12.628 | DEBUG | proxypool.processors.tester:test:65 - proxy 203.28.8.252:80 is invalid, decrease score
2023-03-09 11:13:12.631 | INFO | proxypool.crawlers.base:process:31 - fetched proxy 27.157.228.206:8089 from http://www.66ip.cn/3.html
2023-03-09 11:13:12.632 | INFO | main:run:116 - starting server, pid None...
The text was updated successfully, but these errors were encountered: