Federal Election Commission, United States of America (logo). Link to FEC Home Page
Federal Election Commission

Disclosure Data Weblog

We sat down yesterday afternoon with a group of users of our FTP files to talk about changes we're planning as we move to a different database platform.  First, thanks to everyone who participated - it was very helpful to us and hopefully will improve what we are able to provide going forward.[Read More]

We've started work on several projects for the 2012 election cycle.  Take a look at this list and let us know if we've missed something important or if you have ideas about anything you see here. We plan to have several of these ready for the April quarterly filings this year while others (presidential campaign summaries, more itemized data files) may take a little longer.

  • We're continuing to work on new data sets for the catalog.  At the top of the list is a set of files that will (eventually) replace the standard files on our FTP server.  We're thinking specifically of contributions from individuals to any organization that files with us (e.g. indiv10.zip), contributions and expenditures by committees that are directed at candidates (e.g. pas210.zip) and any transactions where an entity registered with us is involved as both the filer (the one reporting the transaction) and also the recipient or other party to the transaction (e.g. oth10.zip). Our plan is first to duplicate the transactions that appear in these files right now on the FTP server but adding additional information (e.g. separating occupation and employer fields) and offering format choices for download (XML, CSV, etc.).
    • We know this is really important, but it also represents big technical challenges for us.  We're looking at lots of alternatives for searching and distributing very large files (millions of rows) and while we're making progress we haven't settled on a single approach yet.
    • Should we change the definitions of what's included in these files?  For example, do we still need to separate individuals in their own file or should there just be a file with all detailed receipt transactions?
  • We're also working on a couple of new processes to help search and visualize data from the reports we receive. This is our attempt to find something for PACs and Parties that works as well as the maps do as a basic navigational tool for campaigns.
    • One example is a graphical summary of PAC or Party financial information that would be a starting point for searching through different subsets of committees or viewing information about one specific committee.  For example, we might use bar graphs do display summary information about the receipts or disbursements of different sets of PACs (e.g. Corporate or Labor sponsored PACs, Independent Expenditure Only PACs, etc.) with links that would lead to summaries for single committees or groups of PACs.
    • Any thoughts on how we might do this?
  • We're also creating some new summaries for Presidential campaigns.  In 2008 we offered summaries of receipts and disbursements for each specific report - e.g. total contributions by state or total operating expenditures by purpose.  This year we're building similar summaries for each full campaign, not just for a single report. (These don't really become important until July when we might have the second report from at least some Presidential campaigns.)
  • We're also building a new process that combines the "View/Download Electronic Filings" and "View Images of all Finance Reports" menu options so all of the filings and options for viewing and/or downloading information will appear in one listing. (We expect to have this implemented by April.)
  • We're also building new Presidential and Congressional maps for 2012.  Keep in mind that Congressional district boundaries will be redrawn this year, so the Congressional map will be changing as states complete their redistricting processes. (These will be ready for the April 15, 2011 filings.)
  • We're also going to add electioneering communications to our "real-time" data offerings, with a system similar to the one we developed for independent expenditures in 2010. (Not as much time pressure here - as pre-primary windows won't open until around the end of 2011.)

We're happy to hear from you with ideas for any of these or different data projects you think we should be working on in this cycle.

We've begun posting detailed data from electioneering communications filings on the ftp server - ec_exp_2010.csv or ec_exp_2010.txt. (We have some background on this activity and the reporting system.) We'll be posting this file on the same schedule we're using for independent expenditures - a new version at the start of each business day and another one late in the afternoon (eastern time).[Read More]

As we get ready to launch the new data files for independent expenditure and electioneering communication filings during the 2010 general election campaign, I thought it would be useful to talk a little about what we will be including in the files and some of the changes that may come during this campaign season.[Read More]

The reporting requirements for Electioneering Communications (the broadcast ads running within 30 days of a primary or 60 days of a general election that make reference to federal candidates but don't "expressly advocate" their election or defeat) are a little different than most everything else we see, so we're struggling with the best way to present the data.[Read More]

We've posted the 1,600 or so files of detailed candidate spending for 2010 campaigns, and they're now available via the data catalog.

[Read More]

For those of you who would like to get a jump on the release of detailed candidate disbursement data (scheduled for next Monday Tuesday the 11th) here is a link to the schema for the file.  We're actually adding schemas for the other files in the catalog as well. 

We've also updated the draft metadata page for disbursements with some changes that we've made in the last week or so.

Detailed candidate disbursement files should now be posted on May 11.[Read More]

We're working on the front end for detailed candidate disbursement files, and we'd like to get your feedback.  Take a look at these screenshots and let us know what you think.[Read More]

At long last, we're getting ready to create the first set of data files containing detailed entries on campaign committee spending. We're planning to start with data for all 2009-2010 congressional campaigns (including Senate) with data covering the period from January 1, 2009.  There have been a couple of problems in preparing these data, but we think we have an approach that can work now.[Read More]

When you're looking at the new data formats at data.fec.gov, be sure to play with the "Customize Data" button that appears to the right of the format options after you've clicked on a specific file.

This feature is intended to help you focus on a subset of campaigns or committees.  The Leadership PAC list, for example, allows for searches for specific sponsors (i.e. members or candidates who sponsor the PAC) or just those committees that have raised or spent more than some threshold amount that you can choose.

You could do this yourself with the data from the files themselves, but sometimes the volume of data may make it better to narrow the focus before you download the data. 

Let us know if there are other search options that would be helpful for these files.

This is the place where we'll try to help you through the mechanics of using FEC information, give you information about our plans for the future, ask for your help as we think about and develop new disclosure tools, and where you can share ideas and techniques for working with data from the Commission.[Read More]

We're going to try to use this category of the blog to deal with specific questions or problems you find in the data you get from us.  If you find something you don't understand or you think is simply wrong - post a comment here and we'll look into it and report back. 

I'll probably turn some of the comments into new posts -- threads that deal with common problems or issues - but you can also think of this as the tool to use to make us accountable - everyone will see your questions and whether and how and when we respond to them.

This is the sausage-making, so it may not always be pretty, but contrary to the old adage, I think it will be better if everyone can see it happen. . .