Skip to content

Ddr 2256 oai feed

cl334@duke.edu requested to merge DDR-2256-oai-feed into main

It's hard to tell whether this will actually speed up DPLA harvest. But, they had indicated some preference for being able to get 100 records at a time. And I've refactored a bit so that read permission only gets checked once per record. I've also added caching for this read permission check, but since it only helps the second time you make the request this is unlikely to have much impact on the harvest. In my testing once the read permissions are cached the request time per 100 records drops from 18 seconds to 4 seconds, suggesting that the permission check is the bottleneck.

Merge request reports

Loading