File automation

Record source, reference date, and units when collecting public data

Instead of collecting only a title and URL, record the reference date, publication date, access date, units, and terms of use in one row. Includes a CSV template and checklist that need no code.

Show contents

This translation was generated by AI. Check the code, units, and numbers against the original. Native-speaker review has not yet been completed for each language. 한국어

Who this is forBeginners who find and organize public data themselves for reports, market research, or assignments

What you need
  • Prepare a spreadsheet editor that can open CSV files and a web browser. Python is not required.
  • Extract the downloaded ZIP and check source_ledger.csv, README.txt, and CHECKLIST.txt.
  • The 3 included records are fictional demonstration data and contain no real statistics.

01Record data so you can find it again

When you find data to use in a report, record one row right then. Keeping the data title, provider, and detail URL together lets you open the same data again later. Before copying numbers, also write what the data describes, as of when, and in what unit.

source_ledger.csv in this article is a table for recording the context of data. It has no function to collect numbers automatically or judge whether data is current. No actual crawling, API calls, or account connections were made.

02Distinguish three dates and units

ItemMeaningExample or writing rule
reference_dateThe reference date the data describes2026-03-31 (fictional example)
published_dateThe day the data was published2026-04-10 (fictional example)
checked_dateThe day you actually opened and checked the sourceBlank until you open it
unitThe unit in which values are counted or measuredAs written in the source, such as items, people, cases, KRW, or thousand KRW

Do not assume that a portal's modified date is the same as the data's reference date. If the data covers a period, such as monthly or annual data, add the start and end dates and whether it is cumulative to scope_definition. If no reference date is shown, do not substitute today's date; leave it as needing confirmation.

03The role of each of the 14 columns

Column groupCSV columnsWhat to record
Record typerecord_id, data_kindUnique ID and whether the data is fictional or real
Sourcesource_title, publisher, source_urlOriginal title, provider, and detail URL
Datesreference_date, published_date, checked_dateReference date, publication date, actual access date
Interpretationunit, scope_definitionUnit, target, region, and counting definition
Terms of uselicense_url, license_noteWhere the terms of use for the data are and what was checked
Progressverification_status, follow_upCheck status and the next item to check

In source_url, put the data's detail page rather than a search result address. In license_url, record where you confirmed the terms that actually apply. If you downloaded a file, also write the file name and version in scope_definition or follow_up.

04Record one item with the template

  1. Extract the ZIP and copy source_ledger.csv to make a working file. Keep the original template.
  2. In the CSV import, choose UTF-8 and import the ID, date, and URL columns as text. This file does not save column widths or colors.
  3. After checking the 3 fictional example rows, add a row for real data. Choose a record_id that does not overlap, such as R001, and set data_kind to real data.
  4. Open the source yourself to confirm the title and provider, and copy the detail URL. Then write the reference date, publication date, actual access date, unit, and counting scope.
  5. Check the permitted scope of use and the required attribution for the data, and record them in license_url and license_note. The Korean Public Data Portal's usage policy and the KOGL license type guide are linked in the official references below.
  6. Leave unknown items blank and write the check status and what to check next. Save the working file as a UTF-8 CSV under a different name, then reopen it to check.

The data detail screen of the Korean Public Data Portal shows items such as provider, modified date, and permitted scope of use. You can use the actual detail page in the reference documents to practice reading those item names separately. That page is not the source of the fictional examples.

05What the included examples represent

IDFictional dataKey items left blankCheck status
EX001Facilities in fictional region ASource URL, access date, terms-of-use URLSource not checked
EX002Received requests in fictional region BCommon unchecked items + reference dateReference date needs checking
EX003Usage in fictional region CCommon unchecked items + unitUnit needs checking

None of the 3 example rows is marked as record check complete. A blank does not mean 0 or not applicable; it means it could not be checked. No column for real statistics was created, so the examples cannot be cited as evidence for numbers.

The final result is not an automatic report, but a source list that lets you find the source again and track the remaining check items.

06Checklist before using data in a report

  • Open the URL yourself and check that it is the same data as the recorded title and provider.
  • Check that the reference date, publication date, and actual access date are each in the right column.
  • Check that you did not compare different units or scopes as one value, such as people and cases, KRW and thousand KRW, or monthly and cumulative.
  • Review whether you checked the terms of use and attribution requirements for the data.
  • Check that unique IDs do not overlap and that fictional demonstration data has not been mixed into what you actually cite.
  • Change only rows where you actually reviewed the source URL, the three dates, the unit, the definition, and the terms of use to record check complete. If any item cannot be checked, keep another status.

CHECKLIST.txt in the download contains the same check procedure and recommended status values. Record check complete is a work status; it does not guarantee the accuracy or currency of the data, or permission for every purpose of use.

07Common recording errors

ProblemHow to fix it
The source has only the portal nameKeep the original title, provider, and detail URL together.
The reference date was overwritten with the access dateRestore the reference date to the data's point in time and put the actual access date in checked_date.
Only a modified date is shown but it was recorded as the publication dateDo not guess published_date; write in follow_up that only the modified date was checked.
Thousand KRW was copied as KRWKeep the original unit, and if conversion is needed, keep separate calculation evidence.
Blanks were filled with 0Express values you could not check with a blank and a needs-checking status.
Dates and Korean text in the CSV changedIn the import, choose UTF-8 and text columns, then save and reopen.

08Limits of a manual list

  • A CSV has no automatic input validation or change history. Writing a status value does not perform the check.
  • It does not automatically detect changes, withdrawals, or moved links. Recheck the source when you use it.
  • Even with the same unit and reference date, the survey target or counting definition can differ. Judge comparability separately after reading the original description.
  • This article explains a way to record sources. It did not collect or verify real statistics or make individual legal judgments about terms of use.

Execution and verification record

The template structure was checked with the csv, json, and datetime standard libraries in CPython 3.12.14 on Windows 11 (10.0.26200). Users can edit the CSV without Python.

  • Checked 14 CSV columns, 3 fictional records, unique IDs, and date formats
  • Checked the fictional data labels, blank unverified URLs and access dates, and that statuses match the missing items
  • Checked that file names and column names match across the README, checklist, and article
  • Checked the official usage policy, license type guide, and metadata screen links on the web
Verification limits
  • No actual crawling, account connections, API calls, or data downloads were made.
  • Did not verify real statistics, the long-term validity of links, or how the Excel app displays the CSV.

Site-wide writing and verification principles

Example files to run yourself

Includes code, input data, and instructions. Extract the ZIP and read README.txt first.

Download example ZIP

Example code, filenames, and input keys remain unchanged. Refer to the commands and checking steps in the translated article as well.

References

The explanations and examples were written for this site. See the official sources below for the related behavior and concepts.