Koha-clms/misc/migration_tools
Jonathan Druart c6e488f4af Bug 17196: Move marcxml out of the biblioitems table
Two discussions on koha-devel lead to the same conclusion:
biblioitems.marcxml should be moved out this table
- biblio and biblioitems
http://lists.koha-community.org/pipermail/koha-devel/2013-April/039239.html
- biblioitems.marcxml & biblioitems.marc / HUGE performance issue !
http://lists.koha-community.org/pipermail/koha-devel/2016-July/042821.html

There are several goals to do it:
- Performance
As Paul Poulain wrote, a simple query like
  SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear;
takes more than 10min on a DB with more than 1M bibliographic records
but only 3sec (!) on the same DB without the biblioitems.marcxml field
Note that priori to this patch set, the biblioitems.marcxml was not
retrieved systematically, but was, at least, in
C4::Acquisition::GetOrdersByBiblionumber and C4::Acquisition::GetOrders
- Flexibility
Storing the marcxml in a specific table would allow use to store several
kind of metadata (USMARC, MARCXML, MIJ, etc.) and different formats (marcflavour)
- Clean code
It would be a first step toward Koha::MetadataRecord for bibliographic
records (not done in this patch set).

Test plan:
- Update the DBIC Schema
- Add / Edit / Delete / Import / Export bibliographic records
- Add items
- Reindex records using ES
- Confirm that the following scripts still work:
    * misc/cronjobs/delete_records_via_leader.pl
    * misc/migration_tools/build_oai_sets.pl
- Look at the reading history at the OPAC (opac-readingrecord.pl)
- At the OPAC, click on a tag, you must see the result

Note: Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108.

Signed-off-by: Mason James <mtj@kohaaloha.com>

Signed-off-by: Josef Moravec <josef.moravec@gmail.com>
Signed-off-by: Zeno Tajoli <z.tajoli@cineca.it>
Signed-off-by: Nick Clemens <nick@bywatersolutions.com>

Signed-off-by: Marcel de Rooy <m.de.rooy@rijksmuseum.nl>

Signed-off-by: Kyle M Hall <kyle@bywatersolutions.com>
2017-01-13 13:49:26 +00:00
..
22_to_30 Bug 6752: Be stricter with utf-8 encoding of output 2012-01-27 12:11:06 +01:00
buildCOUNTRY.pl Convert to UTF-8. 2010-05-06 17:58:24 -04:00
buildEDITORS.pl Bug 2505 - Add commented use warnings where missing in the misc/ directory 2010-04-21 20:26:44 +12:00
buildLANG.pl Convert to UTF-8. 2010-05-06 17:58:24 -04:00
build_oai_sets.pl Bug 17196: Move marcxml out of the biblioitems table 2017-01-13 13:49:26 +00:00
bulkmarcimport.pl Bug 12478: make things using SimpleSearch use the new version 2016-04-26 20:20:07 +00:00
checkNonIndexedBiblios.pl Bug 12478: make things using SimpleSearch use the new version 2016-04-26 20:20:07 +00:00
create_analytical_rel.pl Bug 5528: Analytic records support 2011-10-13 10:03:39 +13:00
fix_onloan.pl Bug 2505 - Add commented use warnings where missing in the misc/ directory 2010-04-21 20:26:44 +12:00
import_lexile.pl Bug 11368: [QA Followup 2] 2015-09-18 12:40:52 -03:00
koha-svc.pl Bug 14383: misc: Fix some typos in comments and documentation 2015-06-22 17:34:45 -03:00
merge_authority.pl Bug 16010: follow-up of 15381 - FIX merge_authorities migration script 2016-03-21 18:28:46 +00:00
rebuild_zebra.pl Bug 17376 - rebuild_zebra.pl in daemon mode no database access kills the process 2016-10-28 11:28:37 +00:00
rebuild_zebra_sliced.sh Bug 8746 [Follow-up] Replace == by eq in string comparison 2013-04-21 09:23:23 -04:00
remove_unused_authorities.pl Bug 12478: make things using SimpleSearch use the new version 2016-04-26 20:20:07 +00:00
switch_marc21_series_info.pl Bug 9978: Replace license header with the correct license (GPLv3+) 2015-04-20 09:59:38 -03:00
upgradeitems.pl (bug #4518) enhance 2.2 to 3.0 scripts 2011-11-16 17:48:24 +01:00