The Transferencias Constitucionais API changed on the server side: parameter
names became case-sensitive (lower case) and the municipal endpoints became
paginated (page/pageSize, 10 rows per page by default). With the old
upper-case names the server ignored every filter and timed out (HTTP 504),
which looked like an outage.
get_tc_por_municipio() / get_tc_by_municipality() and the _detalhe /
_detail variants now send p_estado, p_municipio (singular), p_ano,
p_mes, p_transferencia and p_sn_detalhar, and fetch every page
(new arguments page_size = 1000 and max_rows = Inf). A page failing
after the first returns the rows fetched so far with
attr(x, "partial") = TRUE.get_tc_por_municipio_detalhe() / get_tc_by_municipality_detail() keep
the original contract, which that endpoint still uses: upper-case names,
P_MUNICIPIOS, no pagination. It now also documents the ten-day
installment columns it returns.The SICONFI report getters were renamed so their scope is explicit:
_ufs suffix:
get_rreo() → get_rreo_ufs(), get_dca() → get_dca_ufs(),
get_rgf() → get_rgf_ufs() (and the English aliases
get_budget_report_ufs(), get_annual_accounts_ufs(),
get_fiscal_report_ufs())._for_state
to _municipios (PT) / _municipalities (EN):
get_rreo_for_state() → get_rreo_municipios() /
get_budget_report_municipalities(), and likewise for DCA and RGF.The old names still work but are deprecated and emit a
.Deprecated() warning; they forward to the new names and will be kept
for at least one release cycle. See ?"tesouror-deprecated".
get_siope_*() functions gained a tipo argument (type in the
English aliases) that filters by entity type on the server via the
DS_TIPO column. Pass tipo = "estado" (or "uf") to fetch only the
state-level row, or tipo = "municipio" for the municipalities, instead
of downloading the whole UF + municipalities payload. Accepts PT/EN
synonyms (accent- and case-insensitive) and combines with an existing
filter via and.co_esfera is now optional in get_rreo() (and the sphere
argument of get_budget_report()), defaulting to NULL. When NULL
the sphere filter is omitted from the request. Some SICONFI entities —
notably the Federal District constitutional fund (id_ente = 1) —
only return data when co_esfera is absent; previously the argument
was mandatory, making those records unreachable. Existing calls that
pass co_esfera are unaffected.CRAN auto-check fixes for the 0.2.1 submission:
R/rreo_tidy.R (in
tidy_rreo()'s @details) with "up to". The original character
broke the LaTeX manual build on r-devel-windows and
r-devel-linux-debian-gcc.https://www.condepefidem.pe.gov.br link from
vignettes/transferencias_pernambuco.Rmd (the agency's site times
out from CRAN's checkers). The CONDEPE/FIDEM attribution stays as
plain text.ords_fetch_all() now returns partial results on mid-pagination
failures. When a page after the first fails (e.g., HTTP 504 after
the retry budget is exhausted), the package no longer discards the
rows it had already fetched. Instead it logs a warning and returns
the partial tibble with attr(result, "partial") = TRUE and
attr(result, "last_page_error") describing the failure. This
matters most for CUSTOS, where the backend timeout caused users to
lose hundreds of rows from a successful first page when page two
stalled.
CUSTOS default page_size lowered to 500 (was 1000). The CUSTOS
load balancer became more aggressive about cutting slow queries; 1000
rows often times out on broad queries even with month and org
filters. 500 is a more robust starting point at the cost of a few
extra round-trips.
More actionable HTTP 504 error message for CUSTOS — explicitly
suggests adding a mes filter and/or reducing page_size, and
reminds the user that partial results are now available via
attributes.
README's CUSTOS quick-start example now passes a month filter so
copy-paste users do not hit the 504 ceiling.
Fault-tolerant batch fetchers for SICONFI. New helpers
get_rreo_for_state(), get_dca_for_state(), and get_rgf_for_state()
(plus English aliases get_budget_report_for_state(),
get_annual_accounts_for_state(), get_fiscal_report_for_state()) fetch
data for every municipality of a Brazilian state in a single call. They
loop over the underlying SICONFI endpoint per municipality and tolerate
per-entity failures: when an individual call cannot be recovered after the
five-attempt retry budget, the failure is recorded and the loop continues.
Failed calls are returned via attr(result, "failed") (a tibble with
iteration, id, error). The on_error argument controls behaviour:
"warn" (default), "stop", or "silent". This addresses the
fault-tolerance and missing-municipality concerns reported in
rsiconfi#2 and
rsiconfi#3.
Distinct reporting for empty responses. The SICONFI API replies
HTTP 200 with zero rows when an entity has not homologated a given
report (a common cause of "missing municipalities" complaints). The new
batch fetchers expose these cases via attr(result, "no_data") (a
tibble with iteration, id), separate from technical failures in
attr(result, "failed").
Layout-aware RREO tidy layer. New functions rreo_layout(),
rreo_normalize_columns(), and tidy_rreo() reconcile SICONFI's
drifting column and account labels across fiscal years. The bundled
inst/extdata/rreo_layout.csv knows that, for example, the federal
RGPS appendix moved from RREO-Anexo 04.3 - RGPS (≤2022) to
RREO-Anexo 04.4 - RGPS (2023+) and that account names with shifting
Roman numerals ("... (VII) = (III - VI)") are matched on a stable
stem. rreo_normalize_columns() adds a coluna_padrao (year-stripped)
and a coluna_ano (the year that appeared in the suffix, or NA),
letting users distinguish a current-year column from a comparative
previous-year column. tidy_rreo(data, topic = "previdencia") returns
a year-stable indicator column ready for longitudinal analysis,
collapsing the manual paste0(... ifelse(year >= 2021, "", " / "), ...)
workarounds that were the workhorse for issue
rsiconfi#4.
Currently ships rules for federal previdência (RGPS, RPPS civis, FCDF,
militares); contributions for additional topics are welcome. See the
new vignette vignette("rreo-longitudinal") for an end-to-end
walkthrough.
New dependency: stringi (>= 1.7.0) (for portable diacritic
stripping; already a transitive dependency via stringr).
Added a hard Depends: R (>= 4.1.0) to reflect the use of the native
pipe (|>) inside the package.
UF abbreviation guard for Transferencias. get_tc_municipios(),
get_tc_por_estados(), get_tc_por_estados_detalhe(),
get_tc_por_municipio(), and get_tc_por_municipio_detalhe() now abort
with an actionable error if a two-letter Brazilian UF abbreviation
(e.g., "PE") is passed where a numeric Treasury state code is
expected. Previously the upstream API returned HTTP 500 after a long
retry budget; the new check fires before any network call and points
the user to get_tc_estados().
tesouror expands the former siconfir package into a unified interface
for all Brazilian National Treasury open data APIs.
siconfir package).organizacao_n1/n2/n3 parameters in the CUSTOS API.tesouror_clear_cache()).page_size parameter to control rows per page (CUSTOS defaults to 1000
instead of the server's slow default of 250; SIOPE defaults to 1000).max_rows parameter on all paginated functions to cap the number of rows
returned. Automatically adjusts limit/$top to avoid fetching
unnecessary data.verbose parameter on every function to print the full API URL for
debugging or testing in a browser/curl. Can be set globally with
options(tesouror.verbose = TRUE).janitor::clean_names() applied to all responses for consistent
snake_case column names.244 → "000244").$filter, $orderby, and $select support for
server-side filtering, sorting, and column selection.c(1, 2, 3))
in addition to colon-separated strings ("1:2:3").