1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
1438
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
1474
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490
1491
1492
1493
1494
1495
1496
1497
1498
1499
1500
1501
1502
1503
1504
1505
1506
1507
1508
1509
1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
1523
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
1539
1540
1541
1542
1543
1544
1545
1546
1547
1548
1549
1550
1551
1552
1553
1554
1555
1556
1557
1558
1559
1560
1561
1562
1563
1564
1565
1566
1567
1568
1569
1570
1571
1572
1573
1574
1575
1576
1577
1578
1579
1580
1581
1582
1583
1584
1585
1586
1587
1588
1589
1590
1591
1592
1593
1594
1595
1596
1597
1598
1599
1600
1601
1602
1603
1604
1605
1606
1607
1608
1609
1610
1611
1612
1613
1614
1615
1616
1617
1618
1619
1620
1621
1622
1623
1624
1625
1626
1627
1628
1629
1630
1631
1632
1633
1634
1635
1636
1637
1638
1639
1640
1641
1642
1643
1644
1645
1646
1647
1648
1649
1650
1651
1652
1653
1654
1655
1656
1657
1658
1659
1660
1661
1662
1663
1664
1665
1666
1667
1668
1669
1670
1671
1672
1673
1674
1675
1676
1677
1678
1679
1680
1681
1682
1683
1684
1685
1686
1687
1688
1689
1690
|
2004-01-26 ############################################ MK 2.4.9.3
Maintenance release, consolidates past 9 months of changes/tweaks.
Fixed test for "__name__" in python/metakit.py to run a quick test.
2004-01-22 Fixed refcount problem with temp rows in Mk4tcl
This was a long-standing bug: "mk::row create" did not work right
because the tracking of temporary rows was completely messed up.
Added test case for Tcl (mk6.8), fixes FB14, BTS#78, and BTS#29.
2004-01-21 Documentation updates
Updated copyright notices to 2004, and udated to Doxygen 1.3.5 for
a new set of C++ documentation. In anticipation of next release.
2004-01-20 Don't trip over duplicate property names
Added code in c4_Field constructor to avoid crashing when there is a
duplicate property name in the format description string. Duplicate
names are now ignored (there is no good way to report errors at this
point). Avoids an even bigger problem: conflicting property types.
Added test s49 to detect this case (FB20, reported by Brian Kelley).
2004-01-18 Fixed rare but very serious subview resizing bug
Fixed rare but serious file damaging bug, when resizing a comitted
subview to empty, committing, and then resizing back to containing
data. Added new s48 test to force this bug to the surface.
Fortunately this usage pattern *never* happens in blocked views!
Fixes are at the end of c4_FormatV::Insert and c4_FormatV::Remove.
2004-01-16 Gracefully deal with bad property type specifiers
When GetAs is a called with a bad description, such as for example
"myview[name:A]", the release code would crash on a null pointer
dereference at some point. Changed so the code now treats any type
it does not know about as "I" (works a bit better than using "S").
The debug build still hits an assertion, as before. Added s47 test.
2004-01-03 Fixed typo in PyView.cpp
Forgot to fix closing brace after the 2003-12-11 mods.
2003-12-21 Fixed Mk4too sorting on subview of length 1
There was a silly bug when sorting on subviews in the new Mk4too
interface (not in Mk4tcl), which returns a view, instead of a list
of integers. In the case of 1 row, optimization was done wrongly,
omitting the sort as well as the remapping. Fixed.
Oomk needs to be patched to work around this (don't sort if n=1).
2003-12-13 Tweak to avoid two unisgned/signed compiler warnings
In remap.cpp, compiled in debug mode on Win32 (DWORD vs. t4_i32).
2003-12-11 Checked in numerous changes to Mk4py by Nicholas Riley
All changes are local to the python/directory - for details, see
http://www.equi4.com/pipermail/metakit/2003-September/001407.html
With a big thank you to Nicholas for contributing these improvements.
2003-11-23 Bumped to Python 2.3, doc tweaks, lots of name fixes
Adjusted makefile to now look for Python 2.3 by default.
Regenerated config files. Fixed obsolete links in the doc files.
Got rid of tons of Metakit "interCap" cases, should be Metakit.
This affects a huge number of source files and one #define (which
has been defined twice for compatibility: d4_MetakitLibraryVersion).
Use "cvs diff -i" to see real changes, other than case swapping.
2003-10-28 Get rid of --enable-python, check in c22.txt
It's not valid, but some files mentioned it. Use --with-python.
Forgot to check in the new c22.txt file added earlier this month.
2003-10-16 Added note to Tcl docs
Added a note to doc/tcl.html on how to load a MK datafiles stored in
another one, as needed when using VFS for example.
2003-10-10 Added c22 test
Added test to make sure groubpy/select bug is not present in the C++
core (bts #75 reports the bug found for Mk4tcl/Mk4too).
2003-10-01 Fixed bugs in Tcl test suite
The tests in tcl/test/ were incorrectly closing non-test datafiles,
such as the "exe" one open while tclkit runs, and needed when a
slave is created which needs to re-run init.tcl etc from VFS.
2003-09-30 Python 2.3.1 & cleanup
Tweaked PWONumber.h and PyRowRef.cpp and MSVC6 project so it can
compile Mk4py for Python 2.3.1 again. Windows binary uploaded.
Removed the win/msvc60/tests/ directory, it's no longer needed.
2003-09-20 Autoconf and libtool rebuilds
In an attempt to stay ahead of version trouble and other nonsense,
the autoconf / configure and libtool files have been regenerated.
Autoconf is at 2.57 and libtoolize is at 1.4.3 on this dev system.
2003-08-26 Documentation fix
Fixed install comments for Mk4py, as reported in bts #59.
2003-07-17 Fixes to Mk4py (Gordon)
Fix crash when db.description(nm) is called for missing view "nm".
Fix wrap - for the special case of wrapping a list of primitives
(eg, ints, floats, strings) in a single property "view".
2003-07-11 Fix for Linux not finding .lai file
Posted for RH 8.0 on MK mailing list by Jeff Web on July 3rd.
2003-07-01 Fixed "Metakit" (preferred) vs "Metakit" (obsolete)
Get rid of InterCappedWords. Time to grow up, d00d...
2003-06-06 Fix to Mk4py for case (in)sensitivity.
When using a dict (or keyword args), makeRow now gets the
names from the dict's keys and gets the properties by name.
This allows case insensitive matching. Note that using an
instance still requires that the instance attributes have
names that match (case sensitive) with the view.
2003-05-15 Add distutils setup.py script (Gordon).
Tested on Linux & Windows (MSVC).
You can now do a plain configure / make (without python)
then cd python; python setup.py build | install
2003-05-08 Fixed array bound bug when not using mmap-ed files
There was an incorrect test, when dealing with a new file and
memory mapping is not enabled (which is uncommon, these days).
Thanks to V Demarco for catching and resolving this bug.
2003-04-28 Sourceforge
Synced to SF's CVS, see http://sourceforge.net/projects/metakit
2003-04-25 Autoconf/libtool update
Did "autoreconf -force" with autoconf 2.5.7 and libtool 1.4.3, as
suggested by Gerfried Fuchs/Ryan Murray. Some Makefile.in tweaks.
2003-04-22 Fixes to Mk4py (Gordon).
Make view.append(instance) work again.
Fix recursively adding subview data.
Make properties compare properly.
Initial (incomplete) unittest based test script.
2003-03-16 ############################################ MK 2.4.9.2
Also allow passing pairs to "mk::row append" as a list (Mk4tcl).
2003-03-10 Fixes for sparc64 configure and AIX strcasecmp
Both changes contributed by Andreas Kupries.
2003-03-07 Fix more bugs in blocked view, add 64-bit Sparc support
The blocked viewer deletion was STILL incorrect. Fixed bad offset
calculations, added several more assertion checks, and added a new
m07 test case which checks for numerous cases of deletion overlap,
i.e. cases where multi-row deletions cross subview boundaries.
Added __sparc9 #define to mk4.h (thanks again, Andreas K)
2003-03-05 Fixed two potential races in C++ threaded build
There was a serious bug in view.cpp, whereby Unix (p)thread locks
were non-functional in release mode (#define NDEBUG). Yikes!
In addition the logic was flawed (both Unix and Windows), failing to
protect from indexing while sPropNames / sPropCounts were being
resized (i.e. a realloc). Added explicit locking to all affected
paths, and removed the now obsolete count locks (i.e. AddRef).
Thanks to Murat Berk for chasing this and explaining the problem.
This bug "only" affects C++ builds. Tcl and Python each have an
extra layer on top which means there can be no races inside MK.
2003-03-03 ############################################ MK 2.4.9.1
Moving to a new 4-level bugfix release number.
2003-03-02 Fixes to Mk4py (gmcm)
Modify some recent patches that were Python 2.2 only so they would
still work with 2.1. Add a view.properties() method (returning a
dict of propname -> Property) for cases where a property is masked
by a method name.
2003-03-01 Reverted changes in Mk4py/scxx, avoid Mk4tcl warning
One was in SCXX, PWONumber.h - ouch and apologies (jcw). Changed
comparison logic in mk4too.cpp (64-bit ints, new code).
2003-02-28 Fixed relaxed layout in Mk4tcl, several Mk4py fixes
Use list operators to convert a Tcl layout to MK format. This used
to crash, Tcl test 6.7 added to verify the fix. Changed test 3.1 to
use a different notation for nested defs (^).
Added to ViewerAsSeq, to allow v1+v2+v3 (thanks Michael Scharf).
Also fixed several mem leaks - thx again!
2003-02-27 Added support for HPUX aCC "long long"
Added #ifdef's to mk4.h to match autoconf HAVE_LONG_LONG settings.
Tweaks to configure.in by Andreas K to better support HP/UX (thx!).
2003-02-26 Added 64-bit int support to Mk4tcl, fix mingw
The "L" type was not exposed, though Tcl >= 8.4 has "wide" ints!
Will now support 64-bit ints, if built against a Tcl 8.4+ header, but
still defaults to without for use in Tcl's <= 8.3.
Fix _strdup #ifdef in univ.cpp when compiled from mingw on win32.
2003-02-24 Break was missing in switch Mk4py
Fixed a serious problem, which must have come from editing too
wildly (Mk4py needs a test suite!).
2003-02-20 Remove a stray include, remove CR's
Remove "#include <stdio.h>" from remap.cpp, leftover from debugging.
Also removed CR's left behind from editing under Windows (doh!).
2003-02-18 ############################################## MK 2.4.9
This is mostly a bug fix release (some features added to Mk4tcl).
2003-02-18 Fixed a bug in blocked view deletion, and hash byteorder
There was an off-by-one error in the deletion of multiple rows
which span more than an entire subview block. Test m06 is ok now.
Also added consistency checks (when compiled in debug mode).
Fixed a too-strict assertion in mk4tcl.cpp, Item destructor.
Fixed a byte-order sensitivity in hash views for numeric properties.
2003-02-17 Configure tweaks for hpux/ia64
Re-instated hpux changes by A. Kupries, for ia64, also -lpthread.
2003-02-14 Bug found in blocked viewer modification
Added test m06 to catch a problem first detected in the Tcl test
suite (test 5.7) - recoded to C++. This is a show-stopper for the
upcoming 2.4.9 release - fixing it is now a top priority.
2003-02-14 Some changes to OO interface in Tcl
The OO "select" cmd now returns a view, not a list of row #'s.
Added "product" and "rename" operators, they were not exposed.
2003-02-14 Enable stdio buffering
On platforms where stdio is used, the setbuf(..., 0) calls have been
removed (fileio.cpp). This improves performance, and lets caller set
up whatever buffering they like.
2003-02-07 Tweaks to restore broken MK ports
Fixes by A. Kupries to fix MK builds I broke (Itanium/HPUX).
2003-02-07 Changed code to avoid compiler warning
In remap.cpp, LookDict(), add return at end to avoid a mistaken
compiler warning (on AIX 5.1). No effect on runtime behavior.
2003-02-02 Work around optimizer bug in gcc 3.2.1
The sign-extension in c4_ColOfInts::Get_16r was not being done right
with -O2 on Linux. This only manifests itself with files having
reversed bytes (e.g. PowerPC/Mac). Changed code to use a local temp
buffer instead. This bug was the reason why some starkits failed to
load when created on Mac and used on Linux.
2003-01-24 Fixed cleanup order bug in Mk4tcl
There was a long-standing bug in Mk4tcl, in which cleanup order of
MkPath objects caused them to access their MkWorkspace parent even
though it was already deleted. This may have caused some of the
crash-on-exit bugs in the past.
2003-01-22 Add missing -lstdc++
For unknown reasons, the current make failed to produce shared libs
with libstdc++ linked in - manually added to LDFLAGS again.
2003-01-19 Tweak to temp object use
Two changes in handler.cpp to avoid bug in compilers which get the
cleanup logic of temp objects wrong (thx, Dan Gregory).
2003-01-17 Add synonym for mk4tcl "info" command
To avoid a name clash, "$view info" can now also be written as
"$view properties" (or an abbreviation of that).
2003-01-16 Allow access to root view in Mk4tcl
Access to root view (i.e. the storage object itself) was not
allowed - added a small change to allow this (MkPath::AttachView).
2003-01-15 Use strdup
On Unix, use strdup i.s.o own code for _strdup, see univ.cpp.
Perhaps it's time to start reversing the names, and make unix std.
2003-01-10 Build improvements, Mk4py long and Mac improvements
Merged changes submitted by Nicholas Riley (thanks!) into CVS:
- changes to build Mk4py on MacOS X (framework/dylib)
- support 'L' fields, handle overflow, throw exceptions
- the beginnings of a test suite for Mk4py (in python/test/)
Separated PPC and 68K projects (Mac classic), because PPC is now
built with 8.3 (Carbon support), while 68K requires 6.3. The x86
cross-compile-from-mac projects have been dropped.
2003-01-09 String compare tweak, Mac Carbon runtime mmap code
Use strcasecmp on unix, instead of own code (string.cpp).
Added code based on Paul Snively's contributed patch to recognize
running under OSX, so carbon apps can benefit from mmapped files.
All changes are within fileio.cpp, requires CW8 to build this way.
Added "PPC Carbon" target to cw.mcp, derived from "PPC DLL" one.
2002-12-23 Tweak for Borland builder 5 & 6
Changed #ifdef line 22 in univ.cpp (fix by S. Cusack).
2002-12-09 Fixed bug in selection view change propagation
Fixed a bug when a row is inserted in a view on which a selection
depends, when the inserted position is not part of the derived one.
This looks like an oversight in 2.3/2.4 changes, and must have been
in there for quite some time. Added new n14 test to verify this.
2002-12-02 Fixed bug in MK old-file format conversion
Fixed bug in on-the-fly conversion of old 1.x/2.0.x format files.
2002-11-24 Fixed Mk4tcl threaded build
Release and reclaim mutex lock while calling eval inside loops.
Added "--enable-threads" option to configure script.
2002-11-22 Configure tweak for HPUX/Itanium
Removed ia64 check in configure.in, now that libtool has been fixed.
2002-11-16 Tweaks to compile on Mac
Small changes to the source code to avoid errors from the MWCW 8.x
compilers. Omit stricmp and strdup with CW version >= 8.
2002-11-04 Fixed typo in Makefile
This prevented Mk4py from getting installed (thanks F. Majid).
2002-11-03 ############################################## MK 2.4.8
Reverted non-portable change in Makefile to copy to "Mk4tcl.*".
2002-10-28 Workaround for bugs on ARM/WinCE and HP/UX, Mk4tcl/WinCE
Turn off c4_ColofInts::Set_8i optimization when compiling for ARM on
WinCE using EVC3. All regression tests now pass (on ARM & x86emu).
On HP/UX, enable copying in fileio.cpp, line 265, so a write is not
done directly from a mmap'ed file (this can hang a process, hard).
Added a "mktcl" subproject to msevc3, to build "Mk4tcl.dll".
2002-10-27 Added multi-thread support for Unix
Added changes to support same appartment-threading model on Unix as
on Win32 (pthreads based). This merely adds support to allow safe
use of the current "each datafile in one thread" design on Unix. All
changes in view.cpp (thank you, M. Berk). Define q4_MULTI to enable.
2002-10-26 Merged WinCE changes
Merged changes to build MK for WinCE using MS Embedded VC 3.0.
These changes are based on Joseph Tate's modifications (thanks!).
2002-10-21 Updated autoconf & libtool (on teevie)
Files in unix/ regenerated with autoconf 2.53a and libtool 1.4.1.
2002-10-16 Added "dup" subcommand to Mk4tcl OO
There was no way to duplicate a view in the mk4tcl OO interface.
Needed to properly deal with re-use / ref counts - added "dup".
2002-10-11 Cast widened in Mk4tcl, support q4_TINY def for Mk4tcl
Changed cast from int to long, to avoid compiler warning on some
64-bit machines (mk4tcl.cpp, line 2013).
Remove float/double code when q4_TINY is defined, also in Mk4tcl.
2002-10-10 Makefile tweaks
Removed duplicate flags from CXXFLAGS definition.
2002-10-09 Fixed blocked/subview bug, tweak for the ARM platform
Blocked viewers were not doing the right thing when rows had subviews
in them - fixed the logic, and add a new m05 test to verify it all.
Fixed a signed-char bug which prevented MK from passing all tests on
the ARM, in this case the Compaq iPaq PDA with Linux and gcc 2.95.4.
2002-10-07 Tweak to prevent gcc compiler bug
Added intermediate temp var in derived.cpp to prevent gcc -O failure.
2002-10-04 Config and makefile adjustments
Adjusted configure.in to use ".sl" for HP-UX, and ".dll" for Cygwin.
Changed "install -d" to "mkdir -p" (2x) in Makefile.in, since the
former is not supported by all incarnations of install (A Kupries).
Added @CXXFLAGS@ to the end of "CXXFLAGS =" lines in Makefile.in,
as suggested by Donal K. Fellows. Used for his IRIX(64) builds.
Added logic to build properly on HP-UX, including a small assembly
file (!) which allows loading C++ shared lib from C, as needed in
Tcl - with thanks to Andreas Kupries for solving and patching this.
2002-09-25 Build tweaks for Mac OS X
Applied patches by Daniel Steffen to deal with ".dylib" (thanks!).
Use -O i.s.o. -O2, which caused test b27 to fail on OS X (gcc 3.1).
2002-09-09 More 64-bit platforms recognized
Added #ifdefs for more 64-bit platforms, thanks to Reinhard Max.
2002-09-08 Make tweaks for HP-UX
Tweaks to build on HP-UX / 9000 (added __hpux #ifdef in header.h).
2002-09-03 Fixed Mac OSX build problem
Compile Mk4tcl lib with stubs only if building the shared lib.
Ignore strip errors (fails with Mk4tcl.so on OSX / dyld libs).
2002-07-01 Python and Tcl installation improved
Now installs Python Mk4py.so and metakit.py in the most common dir
location by default, i.e. "/usr/local/lib/python2.2/site-packages".
Locations can be overridden through $pyincludedir and $pylibdir.
For Tcl, "make install" now constructs a standard package dir, i.e.
"/usr/local/lib/Mk4tcl/" with entries "Mk4tcl.so" and "pkgIndex.tcl".
Locations can be overridden through $tclincludedir and $tcllibdir.
2002-05-30 ############################################## MK 2.4.7
Fix CONST84 logic so source compiles under both Tcl 8.3 and 8.4.
Fix creation of tests/CVS/ so diff in regression tests won't fail.
2002-05-14 Fixed an adaptive int insert/delete bug
Another bug in the 2.3/2.4 codebase, related to adaptive integers.
Symptom: one int entry has incorrect bytes after insert/delete.
Scenario: ints are 1..8 bits, and an odd number are added/removed,
leaving an odd-sized internal "gap". Then store a 16/32 bit value,
forcing resizing. Once this is done, there will be one value which
cannot be properly read or set because its data is split *across* the
gap (commit is ok and removes the problem). Fix in column.{h,cpp},
with a new regression test s46 added to make sure things are ok now.
Let's hope that this is truly the *last* deeply embarrassing bug...
2002-05-06 ############################################## MK 2.4.6
Recent bug fix was critical enough to warrant a new revision.
It is safest to avoid using versions 2.4.2 .. 2.4.5 altogether.
2002-05-05 Fixed major bug in string/bytes after multiple commits
Finally found a way to reproduce spurious bugs reported in the latest
revisions. It turns out that one of the optimizations of the past 2
months (no exact details) caused memo's to be tracked incorrectly in
their free space use. This causes trouble with strings over 10 Kb
(or smaller if there are over 1000 rows).
The bug is forced by new (frightfully short) test cases s44 + s45.
Fixed by performing a slightly less agressive optimization in the
c4_FormatB::Commit (which is also shared with strings, type 'S').
Removed a "--exclude" from diff, which is not portable enough.
2002-05-01 Added support for Windows CE
Patches submitted by Joseph Tate (thank you!), with minor tweaks.
2002-04-29 ############################################## MK 2.4.5
Various bug fixes, fixed a number of platform issues.
2002-04-28 Fix small-int re-use view bug
A nasty bug was reported by VPI which caused upper bytes to be
truncated from int values. The problem appears when storing ints of
1..4 bits in a view, then clearing the view (so a gap is placed past
the end of the column), then adding a row with an int of 2 or more
bytes. This uncovered a bug in forgetting to truncate columns with
sub-byte int storage. Now fixed, added regression test s43.
This bug could also have affected string and byte storage, since
these use int columns to store item sizes. Under very specific
conditions, it may have lead to truncated or even mixed-up values.
2002-04-27 Fix nested mk4tcl loop bug
Loops would exit prematurely when nested - due to objc/objv being
overwritten in the inner loop. Affects mk4tcl.cpp and mk4too.cpp.
2002-04-10 Fix bug introduced in recent blocked viewer optimization
Murphy was at it again. The bug affected the way row inserts and
deletes were done, and can cause incorrect data to be copied. It is
relatively hard to reproduce (the test dataset was 12 Mb), but the
change explains things fully and is in fact very small.
2002-04-02 Fix bug in debug code
In remap.cpp line 531, a debug assertion was moved in the wrong way.
2002-04-01 Backed out to libtool 1.4d, fix test diff and Tcl const
Backed out to the more official 1.4d release of libtool (instead of
the CVS version, which is adding "tags" we will not need anyway).
The unix/Makefile.in has been simplified, back to how it used to be.
Fixed the "diff" call at the end of "make test" so that it no longer
generates extra output if things match and now fails if they do not.
Added fix to allow compiling mk4tcl.cpp with "pre-constified" Tcl
code, thanks to a tip by Don Porter (see "grep CONST84 mk4tcl.*").
2002-03-31 ############################################## MK 2.4.4
Various bug fixes and (blocked view) performance enhacements.
2002-03-28 More blocked optimizations, IRIX tweaks
Switched Slot() to binary search. This seems to slow down a few
percentage point for smaller views, but with 5 millions rows this is
reported to make a huge difference (from code by Zhang Dehua).
Added header "bool" fix by Erik Hofman so MK compiles on IRIX (SGI).
2002-03-27 Added definitions for AIX
Added six operators defs before c4_Cursor class, to avoid compile
errors on AIX. With apologies to Murat Berk for taking so long...
2002-03-26 Re-instated the c4_View::RelocateRows operation
Re-enabled code which supports efficient moves of rows from one view
to another - avoiding copying of subviews. Strings/memos are still
being copied for now. Also moved a slow test out into a new call
"c4_View::IsCompatibleWith", this must be checked to make sure that
RelocateRows can work. Passing incompatible views will still cause
an assertion in debug mode, but must be avoided in release builds.
This change ought to have a dramatic effect on inserts/deletes for
blocked views with large subviews. Added examples/blockdels.tcl to
thoroughly exercise this new code and all boundary conditions.
2002-03-22 Fixed a serious bug in serialization code
When serializing string/bytes columns with large strings using the
c4_Storage::SaveTo function, memo's would sometimes not be written,
leading to a *damaged* datafile (and incorrect free-space tracking).
2002-03-15 Better configure logic, "mk::view layout" fix
Many tweaks to configures, makes, and libtool setup. Get rid of the
library version numbers and the special Mk4*.so targets. Instead of
Mk4tcl.so use libmk4tcl.so (likewise Mk4py.so is now libmk4py.so).
Fixed "mk::view layout", it was broken by the 10-2-2002 change.
2002-03-13 Extend partial access 'B' usage
Added code to Access and Modify to simulate partial data access the
hard way when the underlying view does not support it (c4_Bytes
only), i.e. copy via full temp. Added test s41, doing partial access
on a blocked view.
2002-03-12 Add test for serialized input
The c4_Storage::LoadFrom() call (mk::file load) can be tricky. After
a commit, the header is adjusted so that reading from the start
works. This is not the case in commit-extend mode, where a load will
read th state as it was before extending - it cannot know there is
more.
Added test s40 to verify this case. Also reorged a few more files
(tbasics and tstore4 split into 2 each).
Added test in mk4tl.cpp so LoadFrom failure generates an error
return, instead of being ignored.
2002-03-10 Tweaked March 8 fix a tad further
The workaround implemented below wasn't 100% complete.
2002-03-08 Workaround for file extend on Win
There seems to be a bug when extending a file on at least NT4 with
NTFS (file server works fine). When extending the file in such a way
that a gap is created to save new data during commit, the file
appears to get rounded up to the next 512-byte boundary. At that
point, the datafile no longer has a valid end marker and is sort of
corrupt.
Wrote workaround for Win32 builds, see persist.cpp notes names "March
8, 2002". One way to force this bug is to run "mkhash Dmhs 250000" -
after row 150000, it asserts on bad filesize when built in debug mode
and run on NTFS.
2002-02-19 Fixed over-aggressive optimization
Change made on Feb 7 was releasing too many objects in a commit,
causing it to detach empty top-level views, even when in use. Fixed,
added s39 to test for this case.
2002-02-10 Improve Mk4tcl's "mk::view layout"
Avoid crash when asking for the layout of a non-existent view. Now
returns an error instead.
2002-02-07 Fast commit with many empty subviews
Avoid creating subviews when committing, if these are empty anyway.
Added new s38 test for this case.
2002-02-02 Small optimizations
Changed a few c4_Property instances to const& references to avoid
copying (2 in view.cpp, 2 in custom.cpp).
2002-02-01 ############################################## MK 2.4.3
Bug-fix release, mostly.
Python include path now upgraded to python2.2 (was 2.1).
2002-01-31 Cross-platform serialization, Tcl
There was a bug with serializing a datafile (SaveTo) when it was
created on a platform with reverse endian-ness. Fixed so serialized
data also flags reversed byte order.
Tweaks to fix const changes in the latest Tcl cvs branch. Fixed a
recently-introduced UTF8 path bug in mk4tcl.cpp.
2001-12-21 Optimized GetAs
Now that GetAs is used so much more, optimize the common case where a
description does not require restructuring. Can lead to order-of
magnitude speed improvement in cases where a storage contains many
views.
2001-12-20 Fixed bug in Locate, comparison issue
Testing for the Mk4py changes uncovered a serious bug in
c4_View::Locate, causing it to sometimes return zero, even if there
are matching rows (thanks, Gordon).
But a very fundamental weakness also showed up, being that row
comparisons (and that includes the C++ operators) have the confusing
property of not being symmetric in all cases. The problem occurs
when left- and right-hand sides do not contain the same (number of)
properties. In that case, the *left-hand* row participating in the
comparison determines which properties take part in a comparison.
In the case of Locate, this caused improper comparisons. And it is
very easy to get bitten by this, such as here: c4_RowRef key = ...;
int n = view.Search(key); bool match = n >= 0 && view[n] == key; The
above code is *wrong*. The last line needs to be: bool match = n >=
0 && key == view[n];
This is very clearly a design mistake. Comparisons should have been
*either* implemented *or* named differently.
A new "m04" test has been added to the regression suite.
2001-12-19 Changes to mk4py by Gordon McMillan
Several changes and cleanups. Mk4py now has logic to track different
view categories, e.g. to make sure a R/O view is not being written
to. This should greatly reduce the number of silently ignored
incorrect calls, as well as crashes, and will produce appropriate
error messages instead.
2001-12-18 Cleanup
Cleaned up source comments and got rid of yet more warnings.
2001-12-14 Fixed yet another case of crash-on-exit
The new Unmapped() code of 2.4.2 forgot one case of cleaning up,
which has now been fixed (in c4_FormatB::Commit).
2001-12-12 ############################################## MK 2.4.2
Better portability, hashing improved
This release marks the consolidation of a number of changes, mostly
relating to better portability & hashing. The speed of commits with
many strings and subviews should be notably better. The Tcl
extension no longer needs a "stub" library to compile (it now has
that code itself), just std headers.
2001-12-08 Changes to commit cleanup, Mac stuff
Changed the logic of how ReleaseAllSegments gets called at the end of
commits. There was at least one case of leaving a column pointing
into mapped file space when it was about to be remapped. This should
fix a very long-tanding bug which shows itself as freeing unallocated
memory during commit or cleanup of the storage object.
Changes to test coding and PyRowRef.cpp to deal with builds on
Macintosh (different issues for MacOS 9 and MacOS X). The
mac/cw.sea.hqx project has been upgraded to MW CW 6.3. Verified Tcl
8.3.2 and Python 2.1.1 builds with CW6 on Mac.
2001-12-06 Tweaks to Tcl interface
More robust, added "$vw loop var ... {body}" object command. The
"$vw size" command now takes an optional newsize arg.
2001-12-04 Tweaks to makefile and configure
Tweaks, in preparation of an upcoming 2.4.2 release.
2001-12-03 Changes in M4py, avoid gcc problem, hash
The "-fomit-frame-pointer" option for gcc has been turned off,
because it causes problems with exception handling in Mk4py. All
failures in Mk4py now propagate properly to Python AFAIK.
Simplified Mk4py - by removing a layer of exception handler classes
in scxx. Errors now set info and throw a plain int.
The mkhash.cpp sample program exposed a problem with multi-key
hashing: the order of properties in the search key must match exactly
the order in the hash view itself. For now, this has been left as is
(it's easy to do, once you are aware of it).
2001-11-30 Win MT fix, commit tweak, indent cleanup
Drop static buffer in fileio.cpp (DataWrite), uses stack now, so the
code can be used in MT context even on Win 95/98. It does more
copying than would be needed for NT (2K?), alas.
More changes in c4_FormatB::Commit to properly detect memo use in
blocked views. The recent changes introduced a bug which shows up
only with blocked views and large string/bytes items. Reported by
Steve Baxter with demo, new "m02" regression test.
Changed fileio.cpp to turn off file buffering, this avoids a few
reads when writing and seeking a lot. It does not have as big an
impact as one might expect, but every little bit helps.
Cleaned up new 2-space indentation in several source files.
Added new "mk::file space" in Mk4tcl, to inspect the current file
space usage. This is only intended for internal testing.
2001-11-28 Fixed memory leak in string/memo cleanup
There was a mem-leak in c4_FormatB::Commit which showed up due to
yesterday's more extensive testing. Only showed up after a commit,
in string columns with widely varying item sizes. This caused
regression test s37 to fail in MFC-debug compile.
2001-11-27 Major performance bug fix, and MT strings
A serious problem has been resolved, which slowed down commits, and
prevented blocked views from committing efficiently. The reason was
that for string props, the string size was always being saved anew,
even if no changes in that view took place. This did not affect
proper operation, just speed, and was most noticeable with many
(sub-)views containing many string props.
The solution is in src/format.cpp, the examples/mkhash.cpp code was
further adjusted to better expose and measure the effects. Thanks to
P. Baspeyras and S. Baxter for helping me resolve it.
Another change was to alter the way empty strings are allocated in
the src/string.cpp code, making it compatible with multi- threaded
use and removing the remaining memory leak.
2001-11-26 Fix in assertion check (blocked view)
Corrected an off-by-one bug. Only shows up with debugging on, since
it's inside an assert(). Thanks to Steve Baxter.
2001-11-25 More arg checking in Mk4py, locate
Added more checks against incorrect usage, based on sample code by
Mitch Chapman. The "throw" code appears to be inconsistent when
called at top of *some* calls, using a workaround for now.
Added "view.locate(key)" wrapper, returns (pos,count) tuple.
Various source code formatting adjustments (indents and such).
2001-11-04 Added alternate calls to c4_CustomViewer
Added extra defs to "mk4.h" of Lookup and InsertRows which take a
"const c4_RowRef&" i.s.o. a c4_Cursor. Inlined in "mk4.inl". The
"c4_Cursor" datatype might one day become obsolete.
2001-11-03 Removed tcl/kit/ and copyright notices
Removed the entire tcl/kit/ tree, Tclkit will be distributed as
separate package from now on (the 2.4.1 release still builds ok).
Also replaced all copyright notices by version Id's and an URL.
2001-11-02 Fixed partial memo commit bug, makefile fix
Modifying a small item as memo (i.e. through Modify) properly
committed a change, but subsequently left an incorrect pointer after
the commit. Fixed, and added test s37 to catch this case.
Don't strip symbols from installed static libs (whoops!).
2001-10-31 Fixed Mk4py error flag clear on delete
When deleting rows, a slice was constructed from a PWOSequence, which
generates an otherwise harmless error when its length is checked.
The flag was not cleared, causing errors in subsequent Python
statements. Changed to a PWOTuple in PyView.cpp (2x).
2001-10-26 Fixed Mk4tcl re-open test
The tcl/test/mk1basic.tcl test #6 was reporting open failure on
non-Linux systems. Fixed, the code works, the message was wrong.
2001-10-19 Rearranged some demo files, Lua binding
Rearranged some of the demos/samples from the python/ and tcl/ areas,
and placed them in examples/ instead, for consistency.
Added "selmap.tcl" to illustrate how to turn select into a view.
Added a basic Lua binding (incomplete, but it's a start) in lua/.
2001-10-18 Fixed recent hash bug, and add to ordered
The recent "fix" to deal with hash misses introduced a huge bug,
causing the mapping to be recalculated on each insertion.
Adding to an ordered view did not always work, because the code was
based on SetAtGrow, which is not suitable for an ordered view in
which the row position is determined implicitly. Fixed by changing
c4_View::Add to use c4_View::InsertAt instead.
2001-10-14 ############################################## MK 2.4.1
Custom-extended Tclkit, and threading
Minor kitInit.c change allows wrapping apps as a "custom-extended"
version of Tclkit. Enable threaded Tcl build on Unix.
This release consolidates the most recent fixes and code tweaks.
2001-09-27 Fix temp storage open in Mk4tcl
A recent change made it impossible to open temporary storages from
Tcl ("mk::file open db") - <blush> - now fixed again.
2001-09-19 Bug fixes
Fixed a problem during commit, when memo's are modified, causing them
to be stored inline again. This caused a late reference to mapped
memory - leading to intermittent crashes on commit.
Changes/fixes in mk4tcl.cpp, to prevent a problem when a datafile is
re-opened again under the same name later on. Old references could
in some cases end up stale - leading to crashes much later.
2001-09-05 Bug fixes
Hashing bug fixed: failed to terminate when looking for a missing key
after a hash collision. The fill count was not being tracked
properly to enforce that there is always at least one unused slot.
Fixed bug when setting a string from a higher row: the data gets
trashed, because too little copying was done while creating a gap.
This bug may have led to some other cases of "damaged" datafiles.
Solved by copying input data in c4_FormatB::SetOne().
Fixed long-standing bug with commit-after-load, by now doing a full
view/subview copy. This is inefficient, but it avoids all sorts of
mapping/strategy problems. This also fixes test s33 (at last!).
Added regression tests b27, c21, m01, and s36 to check above fixes.
2001-06-29 ############################################## MK 2.4.0
More changes to the Mk4py interface
- allow setting a row to a value if the row has a single property
- there is an unexplained crash when setting slices with wrong type
2001-06-22 Changes to the Mk4py interface
Modifications and fixes gratefully accepted from John Barnard:
- c4_LongProp support ('L' datatype)
- row.__attrs__ returns the list of all properties
- row.__view__ returns the container view of the row
- row.__index__ returns current position in view
- view.setsize(n) added, extends/truncates number of rows
- generalized makerow to allow any sequence, not just lists
Changed PyRowRef to inc/dec the reference it has to the underlying
view. Should prevent dangling pointer problems, such as deleting a
storage while rows are still in use. This adds a little overhead.
Fixed a PyErr_Clear issue when accessing non-existent properties.
2001-06-12 Close DB filedesc on exec
Added an fcntl call to fileio.cpp, so that on Unix database file
decriptors are closed on exec (relevant when doing "exec ... &").
2001-05-30 Fixed mem-leak in Mk4tcl
A long-standing bug, in TclSelector::ExactKeyProps.
2001-05-28 Security fix in Tclkit
See end of the tcl/kit/README file for deatils.
2001-03-30 Fixed long-standing commit bug
There was an intermittent bug in c4_Persist::Commit, when properties
were "restructured away" (dropped). The bug was hard to track down,
because it depended on what address ranges the O/S assigned to
mem-maps. Might also fix other spurious commit/exit crashes.
2001-03-29 ############################################## MK 2.3.4
The "last" release candidate
Now checked into its *new* CVS home at equi4.com. Mailings list(s)
have also been moved to this site.
2001-03-28 Fix Win build, broken on Mar 27
Dropped kBufMax from mk4.h, it caused compiler errors in MSVC6 -
switched to "sizeof" in a couple of places. This error was
introduced by the double-fix of 3/27.
2001-03-28 Allow builds of Tclkit with Sun CC
Integrated a few changes provided by D.J. Hagberg. Note: the
M-solaris.sh and M-dyn.sh scripts need to be manually edited when
choosing between CC and gcc.
2001-03-27 Double-alignment bug on Solaris
Two changes (c4_Bytes in mk4.h and src/column.h) to fix an alignment
problem for 8-byte doubles on Solaris. This caused tests b17, b23,
b24, s22, and s28 to fail.
2001-03-26 Fixed cross-platform commit bug
There was a nasty bug in the 2.3.x code, which wrote incorrect field
sizes when committing to a datafile with a different byte order
(i.e. created on a machine using different endian-ness from the one
doing commit).
2001-02-14 Removed file events from Tclkit
Changed kit/rechan.cpp to not generate file events. This avoids a
bug in Tclkit whereby an open file can generate a continuous stream
of file events as long as the file is open - the console will seem
to be frozen, though "close $file" does work and fixes it.
2000-12-13 Added missing c4_LongRef export
Added a line in mk4dll.h to resolve references to the new
c4_LongProp/c4_LongRef datatype on Windows.
2000-12-04 Fixed conversion bug
There was a bug in c4_FormatV::OldDefine, causing MK to crash when
trying to convert an old-format file with empty subviews in it. Bug
introduced on 14 Nov.
2000-12-02 Fixes in Tclkit code
Fixed a Tcl-level bug causing memory leaks for all compressed files
stored with MK opened for reading.
Disabled event sources (mk4tcl.cpp and rechan.cpp) to avoid a GUI
freeze-up while a fake file is open.
2000-11-16 Simplified c4_Storage
Made some changes so that a c4_Storage no longer has a separate
c4_Persist* copy. As a result, a storage can now be reconstructed
from any root-level view. This generalizes views, and prepares for
a merge.
2000-11-14 Fixed mem leak in conversion code
The conversion code from pre 2.3 files had a memory leak in
c4_FormatV::OldDefine, causing f06 to leak, as well as several
subsequent erroneous leak reports. Changed a few "new" to "d4_new"
calls along the way.
Remove FlipBytes members, they are no longer needed.
2000-11-08 Tclkit now in the distribution
The "Tclkit" project has been merged into Metakit. Details and
updated build info at "tcl/kit/README". The SourceForge CVS
repository is up to date again.
Mk4py: improved number conversion and error handling.
2000-11-03 ############################################## MK 2.3.3
First final release candidate
Yes, there will probably be a second one as well...
2000-10-31 Improved error handling
More logic added to catch errors in flush and streams. This affects
the C++ core as well as Mk4py and Mk4tcl. API of c4_Stream::Write
changed to return success flag.
2000-10-30 Added autocommit call to Mk4tcl
To better support VFS, Mk4tcl now has a new command "mk::file
autocommit <db>" to force commit on close.
2000-10-26 Changes to compile with Borland C++
Minor tweaks to compile with Borland C++ Builder 4.0, which does not
support "long long". A new Kitviewer has been built (new code to
replace c4_View::Describe).
2000-10-03 Fixes for Alpha Unix
Moved _item in column.h up to fix alignment sensitivity. Config.h
did not get SIZE_LONG right on Alpha Unix (0?).
2000-09-27 Contributed fixes and Python 2.0b2
Adjusted makefile to build with Python 2.0b2 release.
Source code tweaks to avoid DEC CXX 5.7 compiler errors. Add
no-inherit flags for Win32 to not leak file handles.
2000-08-27 Allow derived row deletes in Mk4py
Added code to PyView.cpp to handle deletes (and slice deletes) in
derived views, see "examples/derived.py".
2000-07-30 Major auto-convert 1.8.6 file bug
Bug in on-the-fly conversion of bytes properties ('B') in pre-2.0
datafiles (i.e. 1.8.6 and earlier) resolved.
Unfortunately, this bug can not be 100% unambiguously fixed. The
new code *will* properly detect most cases, and convert both 1.8.6
and 2.0 datafiles on the fly, but especially for views with only a
few rows and at most a few bytes of data per row - the conversion
*might* fail.
In this case, MK will have to be compiled with a define to force it
to either assume all old datafiles are 1.8.6 (-Dq4_OLD_IS_PRE_V2),
or to assume that they are always 2.0 (-Dq4_OLD_IS_ALWAYS_V2). If
you are currently using MK 1.8.6, then you should *skip* the update
to 2.01, and consider updating to 2.3.x. This way you never have
any 2.0 files around, and can force all your code to handle 1.8.6
files properly (by using "-Dq4_OLD_IS_PRE_V2").
See src/format.cpp, c4_FormatB::OldDefine for details.
This bug *only* applies to bytes properties in pre-2.0 data files.
Conversion of 2.0x files is unaffected.
2000-07-25 Fixed new self-referential views
The new recursive / self-referential view definition style has been
fixed, e.g. "view[data:S,self[^]]" will now let you store a tree of
arbitrary depth, with each 'self' subview having data and self
properties. See the demo in "examples/selfref.py" to see how this
all works.
2000-07-22 Fixed bug in double restructuring
Solved a very long-standing bug in restructuring, which caused
incorrect (non-zero, small) default values when a c4_DoubleProp was
added to a view which already had rows.
2000-07-18 Added remapwith and pair to Mk4py
Exposed C++'s c4_View::RemapWith as v1.remapwith(v2), and
c4_View::Pair as v1.pair(v2) in the Mk4py Python binding. Added
pair.py, remap.py, and wrap.py in "examples/" dir.
2000-07-12 Added metakit.py wrapper
Added "metakit.py" script to wrap Mk4py, including a new
metakit.dump() to pretty-print views. More utility code will be
added over time. The preferred way to use Metakit from Python is
now "import metakit".
2000-07-06 Conversion fix, warning cleanup
Fixed on-the fly conversion of old datafiles. The free space was
not managed properly - changed to never touch any data inside the
file during conversion.
Some source code change to get the compile through gcc flags
"-fguiding-decls -Wall -pedantic -Wno-unused". The only remaining
complaint is about using "long long".
2000-07-04 MkSQL subtree, "indexed" mapped viewer
Added the sql and mksql subtrees to the distribution, with Gordon
McMillan's MkSQL engine, written in Python. The "isql.py" script is
a simple interactive shell around it.
Started work on a new viewer which maintains a persistent index (as
a one-int-prop permutation), see src/remap.cpp.
2000-07-03 Mk4tcl fixes
Fixed view rename problem and "delete end" (Matt Newman). Adjusted
the tests in tcl/test/mk5object.tcl accordingly.
2000-06-30 Tequila fixes
Close fix and failure handler (Steve Landers).
2000-06-29 ############################################## MK 2.3.2
First beta release
The new release is 99% feature-complete. What remains is to further
document C++/Python/Tcl use and to fix bugs.
Python sample code in "python/aside.py" and "python/find.py". Tcl
samples in "tcl/test/mk5object.tcl" and "tcl/mapped.tcl".
2000-06-28 Hash/blocked/ordered: changes and fixes
Changed hash insertion to insert at specified position. This makes
it possible to use hashes "under" ordered views. For best
performance, insert rows at end of hash views.
2000-06-26 Documentation, example, Mk4tcl OO fixes
Moved C++ member documentation out of "mk4.h" header. Added
examples/ directory, with a find.py timing example. Fixed bugs in
new Mk4tcl: "$vw find" and "$vw delete end". Added tests for new
Mk4tcl OO interface: ":mk5object.test".
2000-06-16 Improved modifiable custom viewers
The Pair and Slice viewers now support set/insert/remove, while
RemapWith/Concat/Rename support setting values.
2000-06-15 Many changes to the Tcl code, hashing
Contributed by Matt Newman, it adds support for most custom viewers,
including the new hash etc. Added a fast find. Caveat: most old
custom viewers are still not modifiable.
Hash calculation improved, far less collisions than before.
Blocked viewer seems to work. Ordered on top is sub-optimal.
2000-06-12 GetUpperLimit, Blocked, Ordered, mk4too
Removed c4_View::GetUpperLimit (it's equivalent to GetSize-1 and was
not being used anywhere).
Start implementing c4_BlockedViewer, a simple balanced/blocked
nested data structure. Also started on a c4_OrderedViewer, which
keeps the underlying view sorted during changes. These two can be
combined to implement an efficient 2-level btree.
Adopted code by Matt Newman for oo-cmd's for Mk4tcl views. First
trials work, started to extend with new custom viewers.
2000-06-09 Change case of a few Mk4py members
Changed all top-level members in the Python interface to lower case:
storage, property, view, wrap (will break existing code).
Fix bounds check in Mk4tcl.cpp for commit/rollback (new code).
Whoops, forgot to add new src/remap.{h,cpp} to the cvs tree.
2000-06-08 Implemented hash lookup
Added a new virtual c4_Sequence::RestrictSearch, which lets a view
take over searching (used by c4_View::Find). The result is that the
new hash viewer gives a huge speedup for finds. Find requests which
require linear scanning are unaffected.
2000-06-07 Documentation extraction based on Doxygen
The automatically generated output from Doxygen is working out well
and looking pretty, added "src/doxy.h" with more comments.
2000-06-05 Started hash and btree custom viewers
The hash implementation is nearly done, also usable from Python.
Btrees are being implemented as fixed 2-level for now.
2000-06-01 Fixes
Fixed crash when opening missing file r/o new in 2.3.1 alpha. Fixed
incorrect on-the-fly-conversion of 2.0 format subviews. Added
"storage.aside(storage)" to the Python interface.
2000-05-30 Fixed commit-aside
The new commit-aside code was botched by recent changes. Fixed
SetAside to pick up new root seq, changed by implicit rollback.
Note that a commit-aside is not finished until you *also* commit the
secondary file containing all newly generated changes.
Fixed bug in c4_BytesRef::Access, introduced in 2.3.1 alpha.
2000-05-29 Added new 64-bit long datatype
Added support for 64-bit longs (type 'L'), and c4_LongProp, etc.
This type is not autosizing, it always uses 8 bytes per entry. Uses
"long long" or "__int64", else defines struct with 2 longs. This is
not yet correct for platforms which have no 64b ints. No regression
tests or Python/Tcl interfaces yet.
2000-05-28 Better file mark scanning
Added c4_Strategy::EndOfData, to determine the logical end of a
Metakit datafile. This call can be used to check whether a file
contains any data, and whether a commit-extend has been performed.
Old-style scripted documents (with preamble) can now be opened.
Changed strategy class, DataSeek has been merged with read/write.
Removed c4_LoadContext, LoadIt member moved to c4_Persist.
2000-05-27 Tweaked configuration define's
Make the release build the default (no assertions, use inlines).
Enable booleans for gnuc by default (it's pretty standard by now).
Added extra include path to better find Python's includes.
2000-05-26 Fixed Tcl dependency
Changed configure script to no longer look for Tcl if the
"--with-tcl=..." parameter is not specified.
2000-05-25 ############################################## MK 2.3.1
First alpha release
Officially, this is "Metakit 2.3.1 alpha" (ignore "2.3.0" in mk4.h).
All alpha's are 2.3.1 (beta's will be 2.3.2, finals start at 2.3.5).
Builds on Linux/Mac/Win appear ok - as do Mk4py, Mk4tcl, and Tclkit.
2000-05-06 Massive changes to the core
To summarize the main issues: management info is now stored in such
a way that it need not be read in right away - file open is now
instant. The S(tring) datatype is now stored as B, making it far
more scalable (API/use is unchanged). Storage objects now derived
from views, both can be initialized from a stream (data will be kept
in a buffer, beware of potentially large memory use).
Several file format changes are "for future expansion".
2000-05-05 Fixed builds without Tcl
In 2.0.1, the make would fail if there was no Tcl to build with, or
not an appropriate release. Changed Makefile to report and skip Tcl
builds in that case.
2000-04-06 Fixed a nasty restructure/mmap bug
When a property is deleted by a restructure, then committed, then
later committed again, a problem can cause MK to crash. It has only
been detected in debug builds, but the problem turns out to be a
fundamental one (only happens with memory-mapped files, if the file
is resized). Fix in next rel (c4_HandlerSeq::DetachFromStorage).
2000-04-02 Memo properties are no longer needed
The M datatype is gone from the public API (and now illegal).
Everything binary should now be stored in B(ytes) properties, which
then adaptively decide which internal format to use, based on a
simple heuristic (which will be refined later). Existing datafiles
will automatically convert from M to B. The partial Access and
Modify calls now also work on B items.
2000-03-30 Minor change in c4_Strategy
Dropped the _keepAfterCommit flag in c4_Strategy, it probably has
never been used and it interferes with new features.
2000-03-27 Change in API for creating storages
It is no longer possible to create a storage and define its
structure with a single call. Instead, open a storage in r/w mode
(i.e. "1") and then call the (now public) SetStructure member to
define the structure of all views. This change is necessary to
prepare for the upcoming "commit-aside" logic.
2000-03-23 File format changes (in progress)
The new file format has an incompatible header, so old code will not
recognize new datafiles. Major changes are: added a file tail
marker, the serialized format is now a very good way to compress
datafiles, since it can be efficiently opened in on-demand/mmap'ed
mode. The new format supports several planned features. Code to
convert existing files on-the-fly will be added before this change
is released.
2000-03-19 Added c4_Strategy::FileSize
The Strategy::FileSize call is used for a file format change.
2000-03-18 Added c4_View::Locate
Locate returns the number of matching rows, and optionally the
position of the first one, using binary search. Like the
c4_View::Search function, it requires the view to be sorted.
2000-03-17 ############################################## MK 2.01
Maintenance release, it's solid
Updated MK version number to 2.01, this maintenance release
represents a very stable version.
Small change to b07 test to avoid evaluation order problems.
Added unix/metakit.spec file for RPM, thanks to Sean Summers.
2000-03-16 Drop Store, fix deep copy, drop segments
c4_Storage::Store never worked properly under all conditions. It's
been deprecated for some time and has now been removed. Made a
handful of changes to test- and demo code to drop it.
Duplicating a view with deep copy never worked, because it used the
buggy Store call as well. Changed to use recursion.
Dropped support for segmented tree-walk storage, which hasn't been
used since 1.5 (use a commit with 2.0 to convert files). This is
necessary to prepare for some file format changes.
2000-03-15 Modifiable custom viewers, other tweaks
A start has been made with making custom viewers updatable. The new
methods are Set, InsertAt, RemoveAt, and Move, but the number of
viewers which implement this is still limited. Mk4py has been
adjusted to allow "set" on wrapped views.
Removed c4_Strategy::DataLoad, it was only used in one place. Small
optimization of the 2 calls to c4_Streamer::NextByte. Get rid of /
disallow read calls on memory mapped files.
2000-03-14 Makefile tweaks, non-commits smarter
Changed from --enable-tcl to --with-tcl=DIR, because the old
approach only worked with Tcl installed in a standard place.
Commits of a R/O file now fail. Also, if no changes have been made,
a commit will no longer write anything to file.
2000-03-13 Several new commands added to Mk4py
Several changes were submitted by Gordon McMillan, which add better
support for his upcoming SQL engine.
2000-03-12 Allow embedding MK datafile at end of EXE
Mk4tcl was changed to look for an optional trailer for quick access
to the start offset. This makes it possible to append datafiles to
executables, even if they are larger than 4 Kb.
2000-02-29 Fixed rare bug with lots of memo fields
There was a bug in free space management (persist.cpp), which can
only occur when exactly 7500 free space gaps are present, and a
commit crosses the threshold. There was also a small mistake in
that same code causing a bit of free space waste.
2000-02-24 Added proxy support to Tequila
Tequila can now be used as basic client/server setup for Tcl
scripts. See tcl/tequila/README for details and an example.
2000-02-04 Fixed mk::views (Mk4tcl)
The mk::views command failed to list the first view in the file
(this bug was introduced by changes in MK 1.99).
2000-01-02 Adjusted y2k
Copyright and license dates adjusted.
1999-12-26 More Mk4py changes
Added sortrev, and fixed "select(low,high)". Docs updated.
1999-12-23 New view operators in Mk4py
Added rename, project, groupby, and counts operators to Mk4py.
These were already part of the C++ core.
1999-12-22 Avoid GetId inline warning
Reordered GetId in "mk4.inl" to avoid (harmless) inline warning.
1999-12-21 Checked-in Catfish and Kitviewer sources
Added win/catfish and win/kitviewer areas. Catfish was built with
MSVC 1.52, so the win/msvc152 area has also been added.
Kitviewer requires Borland C++ Builder 4.0 to build (using VCL), it
has been adjusted to now also recognize scripted documents.
1999-12-20 Bug fix in set-after-get situations
A bug has surfaced when setting string/byte/memo values which span a
4 Kb block boundary. The bug can only happen if data is first
fetched and subsequently changed. The affected code is in
src/format.cpp (3x). Added Tcl test 5.5 to catch this.
1999-12-19 Mac tweaks
Changes to make the Mac versions build from the CVS repository. The
Mac can also cross-compile Windows libraries using MWCW 5.
1999-12-17 Add the Tequila example
Added the Tequila global Tcl array data server, see tcl/tequila/.
1999-12-15 MK 2.0 Official Open Source release
Removed a bad assertion from FormatX::Compare.
Several new services set up on the excellent SourceForge.com site.
1999-12-14 Documentation added
The C++ API documentation has been added to the distribution, as
well as a document describing the file format details of Metakit.
1999-12-13 Bug fix affecting c4_View::Description
There was a problem with c4_ViewScanner::Describe, due to a change
from c4_String to (const char*). Now c4_View::Store works again.
1999-12-12 MK 1.99 New release, as open source software
The major change is that Metakit has been released as open source
software, based on the liberal X/MIT-style license. Commercial
support remains unchanged for all recent commercial customers, and
for those who purchase the Enterprise License. The Universal Source
license has been terminated, because full source code is now freely
downloadable by anyone from the website.
Sources and documentation files have been adjusted accordingly.
1999-12-08 MK 1.9h Bool support for gcc/egcs, minor fix
Clear _field after delete in c4_HandlerSeq::DefineRoot. This
triggered an assertion on Linux, when compiled in debug mode.
Added pre-processor logic to detect whether gcc supports bools.
Removed all indentation from #define's, #ifdef's, etc. This was
done after a report that some compilers can get confused by this.
1999-12-06 Derived view row copy fix
There was a problem when using SetAt with derived views as source,
due to a remapping problem. Fixed viewx.cpp, added new test b25.
1999-11-25 MK 1.9g Makefile changes, thread-safe Mk4tcl
Renamed options to --enable-python and --enable-tcl, both now off by
default, since most people probably don't want to enable both.
The new "-shared" changes to make Mk4tcl thread-safe have been
folded into the main source code.
1999-11-22 Channel improvements Mk4tcl
There was a close conflict in mk::channel, also several changes to
improve mk::channel fileevent handling.
1999-11-19 Bug fix in Mk4tcl
There was an array overrun when mk::get was called without fields.
Added code to avoid this.
1999-11-11 Mk4tcl exit handling
Simplified Mk4tcl exit handling, fixes "interp delete" crash. Added
new mk5fixed.4 test to catch this case.
1999-11-10 Mk4tcl shared and multi-threaded access
Made a first experimental version of Mk4tcl (1.2.1, not announced)
which allows sharing a database between interpreters and threads.
1999-11-09 STL, MkWrap, compare caching
Tweaked the makefile to support STL builds (also adjusted README).
Fixed bug in MkWrap, calling storage.description() without args.
Yet more fixes in comparisons, this is all one problem, caused by
changes in caching for ints, floats, and doubles. Added B24 test.
These (last?) problems occurred in custom / compound views.
1999-11-08 MK 1.9f Fixed sort comparisons
There was a cache problem with comparisons of int / float / double
sorts. Fixed, also added new B23 regression test to check for it.
1999-11-07 Little nasty details
Tweaked some make/project files. All regress tests and Tcl tests
now reported to really work on Solaris, Linux, Windows, and Mac.
Regression tests required more memory on Mac to get past L03 case.
1999-11-06 MK 1.9e Big oops: Mk4tcl and MkWrap were broken!
Fixed a c4_Strategy / c4_FileStrategy mixup in Mk4tcl and MkWrap.
1999-11-05 Simplify c4_Storage
Moved state out of c4_Storage and into c4_Persist, to prepare for
multi-thread wrappers. Made a new, simpler design to achieve that.
1999-11-04 MK 1.9d Factor out stdio dependencies
Moved all stdio dependencies out of core into new "fileio.cpp" src.
The mk4.h header no longer includes <stdio.h>, added new "mk4io.h"
header with a c4_FileStrategy class, derived from c4_Strategy.
Also factored c4_Stream/c4_FileStream out of the c4_Strategy class.
This alters the API slightly, but makes it 100% portable/embeddable.
Added "tcl/iohan.tcl", a simple wrapper for generic storage access:
locally, on a FTP server, in a local MK datafile, or using a remote
Tequila server (see http://www.equi4.com/tclkit/tequila.html).
1999-11-03 Improved detach/restructure handling
Changed detach to drop all persistent formathandlers, but leave the
number of rows intact. It will be much faster to destroy columns
than to delete (and propagate) rows. The result is that a pointer
to a view of which the underlying storage object goes away will end
up with the same number of rows as before, but no properties at all.
Fixed a problem which would have occurred when properties are being
"restructured away" and then committed. The solution is to check
for this and delete all such properties at commit time.
Moved Buffer() out of c4_HandlerSeq and c4_CustomSeq, and made the
new version in c4_Sequence allocate the c4_Bytes object lazily.
Faster, and decreases sequence object size (for lots of subviews).
Mk4tcl, mk::layout now returns the proper layout even if the views
are empty. Solved by adding extra arg to c4_Storage::Description,
to return structure of a single top-level view. Fixes "mk8basic.1",
and the returned string now has one bogus list layer stripped off.
MkWrap also adjusted with optional arg for storage.description().
1999-11-02 New Wrap code in MkWrap
MkWrap, added new Wrap(seq,props,byPos) member, a c4_CustomViewer
which wraps any Python sequence as MK view (for use in joins, etc).
1999-11-01 MK 1.9c Mk4tcl changes
Mk4tcl, several changes: added "-size" option to mk::get to return
the size of prop value without fetching it (see new basic.9 test).
Added "-globnc" for case-insensitive globbing (for regexp, this is
available through the new (?i) metasytnax of Tcl 8.2 (see basic.10).
1999-10-31 MK 1.9b Solved shared lib unload with Tcl 8.2
Changed property symbol table setup to avoid static initializers, to
work around a problem with shared library cleanup from Tcl 8.2.
Added new c4_Property::CleanupInternalData call to clean up 100%
(this code need not usually be called, only if memory is tracked).
This fixes the crash-on-exit bug in Mk4tcl (Linux and Solaris).
1999-10-29 Make support for MkWrap and Mk4tcl
Both MSVC and MWCW now also build Mk4tcl and MkWrap extensions. The
MWCW project compiles for Win and Mac *on* either Win or Mac.
Makefile extended to build Mk4tcl and MkWrap, added dist target.
Updated to latest Perceps 3.5 beta, started generating docs again.
1999-10-27 MK 1.9a New build / directory structure
Completely reworked the directory structure to simplify all builds.
Created new "builds/" area for all intermediate and output files.
New MSVC 6.0 project structure created in "win/msvc60/".
Moved Mk4tcl to the "tcl/" top-level directory, and MkWrap to the
"python/" dir. The MkWrap code has been removed from the project.
Removed c4_View::Match and the regular expression package, since it
can just as efficiently be done with a wrapper around MK, now that
string results no longer allocate a temporary copy.
Started writing a Tcl-based test suite for use with Mk4tcl.
MAJOR CHANGE SINCE 1.8.6
Merge handler.cpp and format.cpp classes to get rid of special-cased
in-memory version of handlers. This has major effects on how data
is kept for unattached views (they still exist, but no longer
special). The code is leaner and meaner, it passes all regression
tests.
ALSO LISTED IN THE RELEASE HISTORY
Added c4_MemoRef::Access and c4_Memoref::Modify for partial access
to memo fields. Avoids copying and allows inserts/deletes anywhere.
MkWrap and Mk4tcl have both been extended to allow using Memo fields
for simulated file IO (mk::channel for Tcl, MkMemoIO.py for Python).
Added c4_Reference::GetSize to determine the size of a value without
accessing it. For ints, returns negated bit width if 1/2/4 bits.
Added experimental c4_View::RelocateRows to move rows from one view
to another (both must be in same storage, with the same structure).
Moves do not involve any data copying w.r.t. subviews and memo's.
The old release history is at http://www.equi4.com/metakit/history.html
# vim: tw=72
|