37 questions
Score of 1
0 answers
165 views
Error: Request Rate Threshold Exceeded - Your Request Originates from an Undeclared Automated Tool
[W11, Python3]
I am attempting to retrieve SEC filings from sec.gov using their API, and getting this error no matter what I do.
Following the example provided here, including headers:
https://www.sec....
Score of 0
2 answers
199 views
Extract UUencoded images from SEC EDGAR submissions
I am trying to automate the extraction of various files from SEC full text submissions on EDGAR (public company regulatory filings). With python, I can separate the various files, demarcated by ...
Score of -1
1 answer
276 views
How do I access a custom tag in a company's 10q filing?
My issue concerns how to access non us-gapp tagged company data in, for example, a 10-q for the ticker MSFT. See this 10q filing: https://www.sec.gov/ix?doc=/Archives/edgar/data/789019/...
Score of 0
1 answer
1415 views
SEC filings data using API in python with filter for specific strings
I'm trying to extract SEC filings in a certain date range with a certain key string, for several different companies.
Basically I'm trying to replicate the search in this link:
SEC Edgar (https://www....
Score of 1
1 answer
95 views
No output for 13 f scraping, how do I get the program to scrape a 13 f filing in colab research
Complete starter so sorry in advance, I'm getting "Request successful!" and "Number of filings found: 0"
Goal to scrape a 13 F and output the text, but instead I get results ...
Score of 0
1 answer
971 views
SEC EDGAR API to Google Sheets integration
I want to connect US Securities and Exchange Commission (SEC) API to Google sheet. I want to be able to upload files in JSON from SEK server to Google Sheets directly. Buy could not make any of ...
Score of 5
4 answers
4812 views
How to get data from SEC Edgar python and a json
on the following page below there is as Data source a json link:
https://www.sec.gov/edgar/browse/?CIK=1067983&owner=exclude
Data source: CIK0001067983.json -> https://data.sec.gov/...
Score of 1
2 answers
983 views
SQL Server Bulk Insert Text File SEC Data
I am trying to do a bulk insert from the SEC text file named tag. A picture is shown below which includes several columns. I have a table that I am trying to insert the data into but it inserts a ...
Score of -1
2 answers
1246 views
What does the `end` property mean in the XBRL data?
I'm trying to read some programmatic API data from EDGAR, and I'm having trouble understanding the end property. For example, when looking at AssetsCurrent:
"end": "2018-03-31",
&...
Score of 0
1 answer
508 views
SEC's API: Search for US GAAP Taxonomy Frames
Using the SEC's website, I'm looking for the XBRL frames for the WeightedAverageNumberOfDilutedSharesOutstanding concept from the U.S. GAAP taxonomy.
Using this URL results in an error:
https://data....
Score of 0
0 answers
208 views
Save (pre-2012) 13-F filings to Pandas Dataframe using python
I saw the question on pre-2013 13-F filings, but noticed they used an even different format pre 2012. This is the original question: Extracting table of holdings from (Edgar 13-F filings) TXT (pre-...
Score of 1
3 answers
4727 views
Extract entire textual data from Edgar 10-K using python
I am trying to extract entire textual data from the given URL below as an example. I have many URLs so automating. I tried every code posted here - they are giving error, eg AttributeError: 'NoneType' ...
Score of 0
1 answer
105 views
Having issue with XBRL API OAuth2
Has anyone worked with the XBRL API for financial data (https://xbrlus.github.io/xbrl-api/)? I am able to use the interactive demo but not able to recreate it on my own and successfully access the API ...
Score of 0
2 answers
604 views
TIME_TO_SEC is not working Correctly in mysql
" select
SEC_TO_TIME(SUM(TIME_TO_SEC(m.totalTime))) as totalDuration
from m
inner join pd on pd.candidateId = m.candidateId
where m.s_id is not null
and pd.s = 1"
OUTPUT :totalDuration: 838:...
Score of 1
2 answers
791 views
Can ExtractorApi in sec-api module be used for 10-Q filings?
I am trying to extract specific sections from the 10-Q report using ExtractorApi from sec-api module. The module works for 10-K, however, it fails with certain sections for the 10-Q. For example, if I ...
Score of 0
1 answer
275 views
How to build up edgar filing calculations when a fact is summed up multiple ways?
The Edgar documentation has some limited information on how to handle facts with different dimension break-downs. Take as an example the AAPL annual report:
On page 29 the total Net Sales (365,817) is ...
Score of 1
1 answer
696 views
How should I scrape an idx file on EDGAR?
I have an idx file:
https://www.sec.gov/Archives/edgar/daily-index/2020/QTR4/master.20201231.idx
I could open the idx file with following codes one year ago, but the codes don't work now. Why is that? ...
Score of 3
2 answers
718 views
JSONDecodeError: Expecting value: line 1 column 1 (char 0) when scaping SEC EDGAR
My codes are as follows:
import requests
import urllib
from bs4 import BeautifulSoup
year_url = r"https://www.sec.gov/Archives/edgar/daily-index/2020/index.json"
year_content = requests.get(...
Score of 0
1 answer
608 views
SEC Edgar filings extraction master.idx question
I encountered an issue while using the code from https://codingandfun.com/scraping-sec-edgar-python/
I tried to contact the authors of the website, but didn't work out. I am hoping to get some help ...
Score of 1
1 answer
597 views
Getting 403 error while accessing "https://www.sec.gov/" from AWS even after specifying user agent
Response from SEC.GOV for GET request:
Your request has been identified as part of a network of automated
tools outside of the acceptable policy and will be managed until
action is taken to declare ...
Score of 0
1 answer
257 views
Access link href using BeautifulSoup in Python
I am looking for help webscraping the SEC's EDGAR database using BeautifulSoup. I have a list of investment firm names that I am trying to iterate through, and ultimately access their 13F filings.
So ...
Score of 2
2 answers
7623 views
How to Web scraping SEC Edgar 10-K Dynamic data
we are trying to parse SEC Edgar filing using Python .
I'm trying to get this table "Sales By Segment Of Business" at line 21 .
This is the link to the document.
https://www.sec.gov/ix?doc=...
Score of 1
1 answer
1515 views
Python Edgar asks for useragent
I ran the following command:
import edgar
import pandas as pd
edgar.download_index('/Users/myusername/Desktop/Desktop', 2010,skip_all_present_except_last=False)
It's throwing the following error ...
Score of 0
2 answers
636 views
Scraping 13F filings from SEC using R
I'm trying to scrape the data in the SEC FORM 13-F Information Table from the following link:
https://sec.report/Document/0001567619-21-010281/
I tried the below script:
library(timetk)
library(...
Score of 1
1 answer
403 views
Android AR sceneform vertical rotation
Trying to rotate sceneform 3d model to focus on camera and vertical rotation, it should not change angle based on camera angle, using TransformableNode for rotation with Quaternion
node.localRotation =...
Score of 0
1 answer
150 views
Xpath query trying to pull a value from a website table
I am trying to make a loop to go into a list of company profiles on sec.report and gather their "state of Incorporation" but only getting blank results back.
For example, on https://sec....
Score of 0
1 answer
890 views
sec.gov scraping with nested for-loops running into Unicode Error
I am trying to scrape the sec to get all 10-K filing-links of a company selected by input.
The program loops through each quarter (QTR1-4) in each year from 1993 until now.
I got the code from https://...
Score of 0
1 answer
663 views
R - checking HTML for formatting tags (bold, italics etc.)
I am using edgarWebR to parse 10K (SEC EDGAR) filings. I am trying to write an algorithm to deduce whether each HTML element is normal text, a subheading or a heading by checking how the document is ...
Score of 1
2 answers
205 views
Is there a way in python to delete several rows in an csv file?
I'm currently working on the download of the form.idx file from sec.gov for the first quarter of 2016. Since I'm only interested in the 10-Ks, I wanted to download the file as a .csv file and delete ...
Score of 0
0 answers
1190 views
Python Edgar package - get CIK number
I am reading S-1 filings from Edgar sec. I get my initial data from Bloomberg. Through the company name I can look for the matching CIK number using the term get_cik_by_company_name(company_name: str)....
Score of -1
1 answer
471 views
Scraping EDGAR with Python codes (Program 2) not working
I tried the python codes from the article of Rasha Ashraf "Scraping EDGAR with Python". Yesterday I got helped from you great developer(s). Specially Thanks for Jack Fleeting.
The links ...
Score of 1
0 answers
318 views
XBRL / Finstr issue with SEC data in R
I am trying to download the XBRL data from the SEC site, using the finstr package in R.
The vignette references Apple financial statements from 2013-14. I am going after Abbott (CIK 1800) for mine. I'...
Score of 0
1 answer
91 views
How trustworthy are polls by pinpoll
I was recently looking at security issues from online-polls and the problem with online-elections and how they can sometimes very easily be tampered with.
Now it sprung to my eye that a lot of ...
Score of 1
0 answers
857 views
Data seems to be missing in Bigquery SEC Filing Dataset
I was pleased recently to discover that Bigquery hosts a dataset of SEC filings. I am unable to find the actual text of the filings in the dataset however! This seems so obvious I must be missing ...
Score of -1
1 answer
291 views
Can't find a referenced R File on the SEC Website?
I am attempting to understand the 2020q1 data set found here: https://www.sec.gov/dera/data/financial-statement-data-sets.html,
and am using the reference documentation inside the 2020q1 folder as a “...
Score of 0
2 answers
739 views
Find a Pattern across Multiple lines with R
I am trying to identify a pattern across multiple lines, to be exact 2 lines. Since the pattern in either individual line is not unique I am using this approach.
So far I have tried to go with the ...
Score of 1
2 answers
66 views
How to cut all Lines/Characters in R after specific Characters
I am currently taking a course that teaches textual analysis in R. As I am fairly new to R, I could not figure out yet how to cut all Lines after a specific set of characters.
For example, I have the ...