Skip to content

fixing error with model dir and result column #2514

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
patel-bhavin merged 2 commits into from
Jan 24, 2023
Merged

fixing error with model dir and result column #2514

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
820f3c9
fixing error with model dir and result column
nsreekanta Jan 24, 2023
d8e55b0
updating the download link for the model
nsreekanta Jan 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ...experimental/network/detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ search: '| tstats `security_content_summariesonly` count min(_time) as firstTime
| rename answer as text
| fields firstTime, lastTime, message_type,record_type,src,dest, text
| apply detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl
| rename pred_is_unknown_proba as is_suspicious_score
| rename predicted_is_unknown as is_suspicious_score
| where is_suspicious_score > 0.5
| `security_content_ctime(firstTime)`
| `security_content_ctime(lastTime)`
Expand All @@ -41,7 +41,7 @@ how_to_implement: 'Steps to deploy detect suspicious DNS TXT records model into
deep learning model that needs to be deployed in DSDL app. Follow the steps
for deployment here - `https://github.com/splunk/security_content/wiki/How-to-deploy-pre-trained-Deep-Learning-models-for-ESCU`.\

* Download the `artifacts .tar.gz` file from the link - TODO update link here=
* Download the `artifacts .tar.gz` file from the link - https://seal.splunkresearch.com/detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl.tar.gz
Download the `detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl.ipynb`
Jupyter notebook from https://github.com/splunk/security_content/notebooks\

Expand Down
4 changes: 2 additions & 2 deletions notebooks/detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@
"import pickle\n",
"\n",
"# global constants\n",
"MODEL_DIRECTORY = \"/srv/app/model/data/\"\n",
"MODEL_DIRECTORY = \"/srv/app/model/data/detect_suspicious_dns_txt_records_using_pretrained_model_in_dsdl/\"\n",
"vocab_size = 10002\n",
"embedding_dim = 64\n",
"hidden_size = 64\n",
Expand Down Expand Up @@ -550,7 +550,7 @@
" is_unknown_probability_score.append(pred_proba)\n",
" is_unknown.append(pred)\n",
" output = pd.DataFrame()\n",
" output['pred_is_unknown_proba'] = is_unknown_probability_score\n",
" output['predicted_is_unknown'] = is_unknown_probability_score\n",
" output['pred_is_unknown'] = is_unknown\n",
" return output"
]
Expand Down