Skip to content
Toggle navigation
P
Projects
G
Groups
S
Snippets
Help
lichenggang
/
tas_monitor
This project
Loading...
Sign in
Toggle navigation
Go to a project
Project
Repository
Issues
0
Merge Requests
0
Pipelines
Wiki
Snippets
Settings
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Commit
fd8519f7
authored
Apr 08, 2022
by
陈森彬
Browse files
Options
_('Browse Files')
Download
Email Patches
Plain Diff
update
parent
88ab47dc
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
crawler_process.py
crawler_process.py
View file @
fd8519f7
...
...
@@ -67,6 +67,9 @@ def get_error_ratio(task_code, time_range=30):
res
=
requests
.
post
(
url
,
json
=
query
)
# value = response['aggregations']['avgFailRate']['value']
print
(
"-_________"
)
print
(
res
.
json
())
print
(
task_code
)
value
=
res
.
json
()[
'aggregations'
][
'avgFailRate'
][
'value'
]
if
res
.
status_code
!=
200
else
0.0
return
round
(
value
,
3
)
...
...
@@ -79,7 +82,6 @@ def get_crawler_process_info():
p
=
psutil
.
Process
(
int
(
pid
))
info
=
p
.
as_dict
(
attrs
=
[
'cmdline'
,
'create_time'
,
'cpu_times'
])
info
[
'cmdline'
]
=
{
k
:
v
for
k
,
v
in
zip
(
info
[
'cmdline'
][
2
::
2
],
info
[
'cmdline'
][
3
::
2
])}
print
(
info
)
info_dict
=
dict
()
info_dict
[
'pid'
]
=
pid
.
strip
()
info_dict
[
'task_code'
]
=
info
[
'cmdline'
][
'-r'
]
...
...
@@ -94,7 +96,6 @@ def get_crawler_process_info():
info_dict
[
'run_time'
]
=
round
(
sum
(
info
[
'cpu_times'
]),
3
)
info_dict
[
'remain_task'
],
info_dict
[
'remain_wrong_task'
]
=
get_process_task
(
info_dict
[
'task_code'
])
info_dict
[
'wrong_radio'
]
=
get_error_ratio
(
info_dict
[
'task_code'
])
print
(
"cuowulv"
,
info_dict
[
'wrong_radio'
])
process
[
info_dict
[
'unique_code'
]]
=
info_dict
return
process
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment