CVS log for loncom/metadata_database/LONCAPA/lonmetadata.pm

Up to [LON-CAPA] / loncom / metadata_database / LONCAPA

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

Work on Bug #6576

Properly deal with "___" in dynamic metadata keys

Part of Bug #6576: store part and instance info for statistics

Some comments

Bug 6566: convert unix timestamp to sql time before insert into database if the field is of type datetime.

- TYPE=MYISAM was replaced with ENGINE=MYISAM in MySQL 4.
- TYPE was deprecated in 4 and 5.0/5.1.  It is no longer supported in 5.5.

- TYPE=MYISAM was replaced with ENGINE=MYISAM in MySQL 4.
- TYPE was deprecated in 4 and 5.0/5.1.  It is no longer supported in 5.5.

- Correct scalar.

- username is only column for which charset is explicitly set for allusers
  in MySQL table.
  - case sensitive searches for username
  - case insensitive for other fields

- explicitly set charset for allusers MySQL table to latin1.
  (current default for all Linux distros except SuSE 11.3).

- Logging when &sqltime() is unable to convert time.
  - Replace direct call to &log() originally used for this
    from time when &sqltime() was in lonsearchcat.pm;
    (moved to lonmetadata.pm in rev 1.15).

Optimized handling of evaluation comments for metadata:
Only create metadata field, if actual content exisits

Corrected and optimized dynamical metadata "Evaluation Comments":
- Only wrap comments output in div, if actual comment data is available
- Added white space between username and comment

Fix bug 5457
- make delete actions in the MySQL allusers table case sensitive, so changes to a user with username userX do not eliminate the record for user with username userx.

- add in missing test

searchcat.pl
- Additional MySQL table to build: allusers
- &descend_tree() arguments changed. $dom added as first arg, and reference to %allusers hash added as last arg.
- %allusers keys are usernames for all users in the domain which are not courses.
- user information put into allusers MySQL table.

LONCAPA/lonmetadata.pm
- description of allusers table
- &update_metadata(), &lookup_metadata() and &delete_metadata() modified to allow more flexibility in the WHERE condition in the SQL query (no longer forced to be url = ).
- &process_allusers_data() added to add/modify the contents of the allusers table.

- include the domain in the port metadata

- BUG#5248, correct student counting in the avg calculations, also throw out any saved NaN items

- BUG#5248, stop double counting course accesses

Prefer a null value as the option value in a select box when the user chooses "Not specified" - searching in MySQL for IS NULL seems better.

In cases where there are multiple ways to enter metadata for a single field, eliminate storage of comma(s) when the user has not specified anything
for the field.

Advanced search for portfolio files can now include the name(s) of added (course-specified) field(s) with/without the value(s).

addedfieldnames and addedfieldvalues eliminated from the portfolio_metadata table in MySQL - searches do a join on the portfolio_addedfields table instead.

- removing comment

- eliminating a dependency

portfolio_metadata, portfolio_addedfields and portfolio_access tables in MySQL updated when portfolio access controls are modified or when portfolio metadata is updated.

Some routines in searchcat.pl moved to LONCAPA::lonmetadata.pm so they are available to lonsql when performing MySQL table updates on the library server which houses the portfolio files.

metadata updates and access control updates from lonmeta and lonnet::modify_access_controls are routed through lonnet::update_portfolio_table() which in turn does a querysend to dispatch a query to lonsql (via lond).

Only access control settings for public and passphrase-protected controls are stored in the portfolio_access MySQL table.

Moving &sqltime() from searchcat.pl to lonmetadata.pm so it can accessed elsewhere when usin Apache::lonmetadata().

Support for searching for portfolio files using metadata associated with a file. Three new MySQL tables added - portfolio_access, portfolio_metadata and portfolio_addedfields.  Both personal portfolio and course group portfolio files with currently active access controls are included.

Bug #4486: set fields to appropriate "empty" values if nothing is set

searchcat.pl:Bug 3961 - metadata only processed for default domain on
    multi-domain servers.  Now takes command line option -multi_domain.
    This causes a hostname lookup and the hosts.tab file to be parsed for
    matches of the hostname.  Added 'domain' to the dynamic metadata.
lonmetadata.pm:Added 'domain' to the metadata table and to the dynamic
    metadata;

Ignored "correct" evaluation data

lonmetadata:
  Minor changes to &store_metadata, should be a little more readable now.
  &lookup_metadata: added $tablename input parameter, defaults to 'metadata'.
  Implemented &delete_metadata
  Added &update_metadata
lonmetadata_test.pl:
  Added tests for &lookup_metadata, &delete_metadata, and &update_metadata
  Added utility routines &metadata_do_not_match, &metadata_mismatch_error,
  &testrecords, &build_test_table.

Added degree of discrimination to metadata storage.

lonmeta.pm: Added degree of discrimination output.
Added 'detailed assessment statistical data' output, a table of classes,
sections, and various statistics which make up the 'overall assessment
statistical data'.
lonmetadata.pm: Documented data storage in nohist_resevaldata.db
&process_dynmaic_metadata now uses a weighted average for statistics, and
reports the sum of the maximum number of students per class as 'stdno',
since there may be multiple entries per class.
Added &dynamic_metadata_storage which prepares statistical data for
storage in nohist_resevaldata.db.
lonproblemstatistics.pm: Use lonmetadata::dynamic_metadata_storage to prepare
storage of dynamic metadata.

&process_dynamic_metadata:
Reworked html around evaluation comments.
Actually put the comments into the returned data structure now, instead of
just letting perl garbage collection throw it away.

Added &LONCAPA::lonmetadata::metadata_col_to_hash.
Modified lonpublisher.pm and lonsearchcat.pm to use it instead of the
version in lonmeta.pm.

Moved nohist_reseval parsing functionality from searchcat.pl to lonmetadata.pm.
searchcat.pl: stop dying on insert errors.
lonmetadata.pm: &store_metadata now translates 'nan' to 'NULL' because MySQL
won't take 'nan' in a numeric field.
Added &process_reseval_data and &process_dynamic_metadata routines.

Modified &store_metadata to take a table name as a parameter.

Modified lonmetadata::create_metadata_storage to take an optional parameter
for the table name to make life a little easier in searchcat.pl.
Added test for it to lonmetadata_test.pl

Implement store_metadata.  lookup_metadata is not tested in the least.

First swipe at consolidating the metadata table creation routines.  Designed
to be used in scripts as well as the httpd.  Table creation and table
description are implemented.