]> git.ipfire.org Git - thirdparty/sqlite.git/log
thirdparty/sqlite.git
6 years agoHave ALTER TABLE RENAME COLUMN also edit trigger and view definitions.
dan [Sat, 18 Aug 2018 18:01:58 +0000 (18:01 +0000)] 
Have ALTER TABLE RENAME COLUMN also edit trigger and view definitions.

FossilOrigin-Name: 7908e8a4a3b9577211a5d3da9c4142c46e9d5872be4a6499ec053f2b547019b8

6 years agoImprovements to error handling in ALTER TABLE RENAME COLUMN. edit-trigger-wrapper
dan [Sat, 18 Aug 2018 17:35:38 +0000 (17:35 +0000)] 
Improvements to error handling in ALTER TABLE RENAME COLUMN.

FossilOrigin-Name: 7fa1faeaff30b74b68ee6f4b363d837f21cf313d8262361c901bda884df139a2

6 years agoAllow an ALTER TABLE RENAME COLUMN to proceed even if the schema contains a
dan [Fri, 17 Aug 2018 18:08:28 +0000 (18:08 +0000)] 
Allow an ALTER TABLE RENAME COLUMN to proceed even if the schema contains a
virtual table for which the module is unavailable.

FossilOrigin-Name: 7b72b2360a70eb1f788b3c4d745967dfedb2c80af6b2e146ba940a3741fd51a1

6 years agoEnsure that CREATE VIEW, TRIGGER or INDEX statements can be edited by ALTER
dan [Fri, 17 Aug 2018 17:18:16 +0000 (17:18 +0000)] 
Ensure that CREATE VIEW, TRIGGER or INDEX statements can be edited by ALTER
TABLE RENAME COLUMN even if they use collation-sequences or
user-defined-functions that are not available.

FossilOrigin-Name: 540014efd6a048373313c6cd9413de10d5d7114daf537cf5999ccf3c5c3f9358

6 years agoFurther progress on updating trigger programs as part of ALTER TABLE RENAME
dan [Thu, 16 Aug 2018 19:49:16 +0000 (19:49 +0000)] 
Further progress on updating trigger programs as part of ALTER TABLE RENAME
COLUMN.

FossilOrigin-Name: 3f47222b6e20e1c1ef41c0f7391c8b5c7648e2a2d6013303d155ad59ce27143a

6 years ago(no comment)
dan [Wed, 15 Aug 2018 20:28:39 +0000 (20:28 +0000)] 
(no comment)

FossilOrigin-Name: e272dc2b1c0edab59a40f32c77c81a3e636937280524161eff5669cb0046ad84

6 years agoFix a problem when renaming an IPK column that is also part of a child key.
dan [Tue, 14 Aug 2018 21:05:35 +0000 (21:05 +0000)] 
Fix a problem when renaming an IPK column that is also part of a child key.

FossilOrigin-Name: 6e6a2bfdbbfd4ffc14be88962ff97bf3c626fef9d1a337715d2a4be1a657fb0d

6 years agoFix a problem when renaming an IPK column that is also part of a child key.
dan [Tue, 14 Aug 2018 21:03:38 +0000 (21:03 +0000)] 
Fix a problem when renaming an IPK column that is also part of a child key.

FossilOrigin-Name: ad15486022209205c65fb5ffdbe30a7b99379170451e6aff4bab6e90b549d6c7

6 years agoMerge latest trunk and ALTER TABLE error message improvements into this
dan [Tue, 14 Aug 2018 20:40:25 +0000 (20:40 +0000)] 
Merge latest trunk and ALTER TABLE error message improvements into this
branch.

FossilOrigin-Name: 7a45802dafaed3c058f59d1487fe8091e1f309cc5f0a5bcf2579f0bdd8e92d89

6 years agoDo not allow ALTER TABLE RENAME COLUMN on a virtual table.
drh [Tue, 14 Aug 2018 20:38:18 +0000 (20:38 +0000)] 
Do not allow ALTER TABLE RENAME COLUMN on a virtual table.

FossilOrigin-Name: f6d6b472713c21deace3fd52c0b0b6901d758af043c238f004fabe52b01f730c

6 years agoHave ALTER TABLE RENAME edit column references in CREATE VIEW statements.
dan [Tue, 14 Aug 2018 20:18:50 +0000 (20:18 +0000)] 
Have ALTER TABLE RENAME edit column references in CREATE VIEW statements.

FossilOrigin-Name: db829dc1a2d7afa49798a2fd32d1f070185b23e513416e65d8144fda24f23b50

6 years agoImproved error messages when an ALTER TABLE RENAME COLUMN fails due to a
drh [Tue, 14 Aug 2018 19:27:51 +0000 (19:27 +0000)] 
Improved error messages when an ALTER TABLE RENAME COLUMN fails due to a
duplicate column name.

FossilOrigin-Name: 37d11b8e8224a8b241ff57b9c4b9499db39dde4ddcb56ff8b03a3d08091a4c11

6 years agoMerge fixes and enhancements from trunk.
drh [Tue, 14 Aug 2018 18:12:33 +0000 (18:12 +0000)] 
Merge fixes and enhancements from trunk.

FossilOrigin-Name: dff0314b7e7ef2d04375ff21fbf89039bf5f64a9cdca53d7bc7120faacd92c06

6 years agoFix ALTER TABLE RENAME COLUMN in cases where the column being renamed is an
dan [Tue, 14 Aug 2018 16:18:19 +0000 (16:18 +0000)] 
Fix ALTER TABLE RENAME COLUMN in cases where the column being renamed is an
IPK declared with a separate PRIMARY KEY clause - "CREATE TABLE x(y INTEGER,
PRIMARY KEY(y))".

FossilOrigin-Name: 32ca8418df8735a6c53e53153f733579e514711f091e4e09ecce83db85fe4d85

6 years agoFix UPSERT so that it checks the target-constraint first and fires the
drh [Tue, 14 Aug 2018 15:12:52 +0000 (15:12 +0000)] 
Fix UPSERT so that it checks the target-constraint first and fires the
DO UPDATE if that constraint is violated regardless of whether or not
other constraints are in violation.  This aligns SQLite behavior with
what PostgreSQL does. Fix for ticket [908f001483982c43cdb476dfb590a1a].

FossilOrigin-Name: 529fb55e3d00472f13446117527b0896827b11e870b581af7fe7cbb7392ef3cd

6 years agoStop requiring the global VFS mutex to access the unixInodeInfo.pUnused field.
drh [Mon, 13 Aug 2018 22:50:34 +0000 (22:50 +0000)] 
Stop requiring the global VFS mutex to access the unixInodeInfo.pUnused field.
The unixInodeInfo mutex is sufficient.

FossilOrigin-Name: e3ea43dabf099dc2954c23d348638e7b2a8b9122d2994154bc649a2c09260c46

6 years agoTake extra precautions to ensure access to unixInodeInfo.pUnused is protected
drh [Mon, 13 Aug 2018 20:46:18 +0000 (20:46 +0000)] 
Take extra precautions to ensure access to unixInodeInfo.pUnused is protected
by all necessary mutexes.

FossilOrigin-Name: 8b1e0010b9e0b548a90087f4d25843d2b40f7e9551722ac587fa925d37b510c2

6 years agoEdit the WHEN and UPDATE OF clauses of trigger programs as part of ALTER TABLE
dan [Mon, 13 Aug 2018 17:14:26 +0000 (17:14 +0000)] 
Edit the WHEN and UPDATE OF clauses of trigger programs as part of ALTER TABLE
RENAME COLUMN.

FossilOrigin-Name: 5fdb6b0aafba727139e1937ef5950e4434a77f95a10fc46f8010ca2de3922326

6 years agoMake the sqlite_rename_column() SQL function resistant to problems caused
drh [Mon, 13 Aug 2018 17:02:26 +0000 (17:02 +0000)] 
Make the sqlite_rename_column() SQL function resistant to problems caused
by OOMs and/or malformed parameters submitted by hostile application code.
Also add additional comments to the RENAME COLUMN logic.

FossilOrigin-Name: 87743ddef11749b4017d60abc297abfd673e02a26a2ae45ffec861327578aa30

6 years agoFix legacy comments on Token. Begin commenting the new ALTER TABLE RENAME
drh [Mon, 13 Aug 2018 15:09:48 +0000 (15:09 +0000)] 
Fix legacy comments on Token.  Begin commenting the new ALTER TABLE RENAME
COLUMN code.  Fix a memory leak in the sqlite_rename_column() SQL function.

FossilOrigin-Name: 32edc8920376aabb84ebe1900eaa9512d23f1b44d6459e4916dc6b07db66e27c

6 years agoFix issues with ALTER TABLE RENAME COLUMN associated with OOM errors.
drh [Mon, 13 Aug 2018 13:43:11 +0000 (13:43 +0000)] 
Fix issues with ALTER TABLE RENAME COLUMN associated with OOM errors.

FossilOrigin-Name: 0b28dd5c2e4908d5e49eaedd359492e46de8af3bf84120f4683b3ea906882fbf

6 years agoFix an incorrect comment on the unix-nolock VFS object. No functional
drh [Mon, 13 Aug 2018 11:32:07 +0000 (11:32 +0000)] 
Fix an incorrect comment on the unix-nolock VFS object.  No functional
code changes.

FossilOrigin-Name: 90f7c193b42f0d8120a8e429bdea5e1cec5d3f45b901db8fc5a5c2ca3e69cba8

6 years agoAdd the "atrc" test program. "Atrc" is short for "ALTER TABLE RENAME COLUMN".
drh [Sat, 11 Aug 2018 20:46:54 +0000 (20:46 +0000)] 
Add the "atrc" test program.   "Atrc" is short for "ALTER TABLE RENAME COLUMN".
See the header comment on the program itself for further information.

FossilOrigin-Name: ed64a55a2242408ac0b889b330cf91d38a954399b75c6ebe71232613b864c70b

6 years agoIf the new column name in an ALTER TABLE RENAME COLUMN statement is quoted,
dan [Sat, 11 Aug 2018 20:38:33 +0000 (20:38 +0000)] 
If the new column name in an ALTER TABLE RENAME COLUMN statement is quoted,
then also use quotes for the column name in the edited SQL statements.

FossilOrigin-Name: ca5184a25f9150540a3e401ef67df0606efa7a294d70e3fa5edad9854003eb36

6 years agoAvoid an assert() sometimes triggered by ALTER TABLE RENAME COLUMN in non-debug builds.
dan [Sat, 11 Aug 2018 18:34:25 +0000 (18:34 +0000)] 
Avoid an assert() sometimes triggered by ALTER TABLE RENAME COLUMN in non-debug builds.

FossilOrigin-Name: 520c1c75dae5e3f4695fcdf0aad5fb9f492f0e528b5fbb49d5d3b5fc02762f47

6 years agoFix a bug causing ALTER TABLE RENAME COLUMN to fail when renaming an IPK
dan [Sat, 11 Aug 2018 17:49:23 +0000 (17:49 +0000)] 
Fix a bug causing ALTER TABLE RENAME COLUMN to fail when renaming an IPK
column that is used in a CHECK constraint.

FossilOrigin-Name: 6595c8811f13719d0aed8041abc7e1cade41c57427bcbf3503e2e42408eaa03b

6 years agoFix a bug causing all ALTER TABLE RENAME COLUMN commands to fail if ANALYZE
dan [Sat, 11 Aug 2018 17:34:38 +0000 (17:34 +0000)] 
Fix a bug causing all ALTER TABLE RENAME COLUMN commands to fail if ANALYZE
had been run on the database. Also prevent the user from renaming the columns
of system tables.

FossilOrigin-Name: ca644a2877c26561f8fb3b3feb74a070cd46621acb105577f04bc936c9b72a95

6 years agoReload the entire schema after renaming a column in order to ensure that the
dan [Sat, 11 Aug 2018 13:40:20 +0000 (13:40 +0000)] 
Reload the entire schema after renaming a column in order to ensure that the
schema for any tables for which parent key definitions were changed are
reloaded.

FossilOrigin-Name: f4497b0136e9fcb1121a834c86f84eeaf8f1e7d3157d409484e086bcef3487f1

6 years agoEnsure the schema cookie is changed when a column is renamed.
dan [Fri, 10 Aug 2018 20:19:34 +0000 (20:19 +0000)] 
Ensure the schema cookie is changed when a column is renamed.

FossilOrigin-Name: 2dec9ea4ab1779d00bb22add0aa9a8536661d8abc9f4c2fb8628e04d4cd84326

6 years agoFix harmless compiler warnings.
drh [Fri, 10 Aug 2018 19:33:09 +0000 (19:33 +0000)] 
Fix harmless compiler warnings.

FossilOrigin-Name: 9564d7008c3fd804401a5da6ea342c6f4261db14e9f994d1a38883358a7c6f8c

6 years agoWhen a column is renamed, update any references to it in REFERENCES clauses
dan [Fri, 10 Aug 2018 19:19:33 +0000 (19:19 +0000)] 
When a column is renamed, update any references to it in REFERENCES clauses
that belong to other tables.

FossilOrigin-Name: 191079bd4f774528a1e39b71b4a4ce7859dee0edf0ce72e4b6968ae889dc35c8

6 years agoMerge latest trunk changes with this branch.
dan [Fri, 10 Aug 2018 15:27:55 +0000 (15:27 +0000)] 
Merge latest trunk changes with this branch.

FossilOrigin-Name: c355a8370782aa70f155ee956fa0faec7f45d7c483c442b169b63c5f0a988fd3

6 years agoFix a problem with renaming columns on tables with REFERENCES clauses that
dan [Fri, 10 Aug 2018 14:23:41 +0000 (14:23 +0000)] 
Fix a problem with renaming columns on tables with REFERENCES clauses that
specify a large number of columns.

FossilOrigin-Name: d48f7bbdf4a1686c25e634a8dec6ead88bf2866fee94ed8e5058f830363424a8

6 years agoFix the isLikeOrGlob() routine in the WHERE clause processing logic so that
drh [Thu, 9 Aug 2018 21:45:45 +0000 (21:45 +0000)] 
Fix the isLikeOrGlob() routine in the WHERE clause processing logic so that
it avoids signed/unsigned character comparisons, as that can lead to an
incorrect answer if the ESCAPE clause is an invalid UTF8 string.  Problem
found by OSSFuzz.

FossilOrigin-Name: 4195a3f8b5d2c2ec63771890c5aa7b5e2de60b9fa2273652730239b8577ae418

6 years agoExperimental implementation of ALTER TABLE ... RENAME COLUMN. Still buggy.
dan [Thu, 9 Aug 2018 20:47:01 +0000 (20:47 +0000)] 
Experimental implementation of ALTER TABLE ... RENAME COLUMN. Still buggy.

FossilOrigin-Name: fa0fc01eb48a864f0a3d43f9b805d5ed2e530846ee0c34fcbc2eabd9e5696277

6 years agoWhen a column must be a constant due to WHERE clause and the value of that
drh [Thu, 9 Aug 2018 18:36:54 +0000 (18:36 +0000)] 
When a column must be a constant due to WHERE clause and the value of that
column is being coded as a constant, make sure the affinity is correct.

FossilOrigin-Name: 7404ea83168e6c739ebe8fc5d65bbf0265432ccb35b3418bb0381d74362f7527

6 years agoMinor style improvements.
mistachkin [Wed, 8 Aug 2018 20:46:35 +0000 (20:46 +0000)] 
Minor style improvements.

FossilOrigin-Name: 60bbca2b9a591800cd8e7b374e62d75b1df0e8fd2d2f71f9b4d5fd044da78be0

6 years agoEnhance the edit() function so that it converts text from \r\n back into \n
drh [Mon, 6 Aug 2018 02:08:53 +0000 (02:08 +0000)] 
Enhance the edit() function so that it converts text from \r\n back into \n
only if the original unedited copy contained no \r\n values.

FossilOrigin-Name: 20c995d3f0f4de5410962172cb59da0f25edf0c62e199420186cc59ea874e981

6 years agoAdd the --info option to the fuzzcheck test utility.
drh [Mon, 6 Aug 2018 01:39:31 +0000 (01:39 +0000)] 
Add the --info option to the fuzzcheck test utility.

FossilOrigin-Name: 1caaaaa70f21fe71fbe0af227eea8d1367870e2575eedf248cc2a0b515783390

6 years agoFix an overzealous assert() statement discovered by OSSFuzz.
drh [Mon, 6 Aug 2018 01:21:53 +0000 (01:21 +0000)] 
Fix an overzealous assert() statement discovered by OSSFuzz.

FossilOrigin-Name: d9c9fe9f5ad3fc9123ad29ebafcb7f40dcecd448fb7a928bb31bea8181d81ec1

6 years agoRemove the column-cache from the code generator. The column-cache has been
drh [Sat, 4 Aug 2018 20:30:55 +0000 (20:30 +0000)] 
Remove the column-cache from the code generator.  The column-cache has been
a persistent source of bugs for years and with recent improvements
in the performance of OP_Column, it no longer provides a benefit.  After
the column cache is removed, the binary is almost 2KB smaller and the
speed-check.sh performance test is over 3 million cycles faster.

FossilOrigin-Name: cdff3af7bedc5ebea04bd9b5e2112d3db451a475c18c9a9ebd45f6f3a89a43cb

6 years agoRemove a testcase() that is no longer reachable without the column cache. omit-column-cache
drh [Sat, 4 Aug 2018 20:12:10 +0000 (20:12 +0000)] 
Remove a testcase() that is no longer reachable without the column cache.
Provide an assert() to help prove that the testcase is no longer reachable.

FossilOrigin-Name: a500893b6f64aced197cd32b79d51a481629a39d45dbcf0f02d65e5451ac4706

6 years agoFix comments that were made obsolete by the removal of the column cache.
drh [Sat, 4 Aug 2018 17:15:56 +0000 (17:15 +0000)] 
Fix comments that were made obsolete by the removal of the column cache.

FossilOrigin-Name: 2041231d56c7b02b785015ef4d1af260d61326eab1b2a304c17faa3e33f76441

6 years agoRemove more column-cache residue: The OP_SetColTab and OP_VerifyColTab
drh [Sat, 4 Aug 2018 16:54:53 +0000 (16:54 +0000)] 
Remove more column-cache residue:  The OP_SetColTab and OP_VerifyColTab
opcodes and the associated SQLITE_DEBUG_COLUMNCACHE logic.

FossilOrigin-Name: 80236e81cefdf3d3cda3dbdb6de1575c38e4e248cc4b72ca9ee96d3aa0464bfd

6 years agoFurther logic simplifications that flow out of the omission of the column cache.
drh [Sat, 4 Aug 2018 15:53:55 +0000 (15:53 +0000)] 
Further logic simplifications that flow out of the omission of the column cache.

FossilOrigin-Name: 7d9072b027cc28dd8ecf5e2686d821017997445c15124eebe2839984622af4db

6 years agoAdd test cases for the constant expression fix of the previous check-in.
drh [Sat, 4 Aug 2018 15:28:12 +0000 (15:28 +0000)] 
Add test cases for the constant expression fix of the previous check-in.

FossilOrigin-Name: 95db5bd9fea86a10c9528dd24841e1370dfdc0bbb5c98b7cbd808a8bc59dd48f

6 years agoEnsure that all expressions that are to be evaluated once at the start of
drh [Sat, 4 Aug 2018 15:16:20 +0000 (15:16 +0000)] 
Ensure that all expressions that are to be evaluated once at the start of
a prepared statement (the Parse.pConstExpr expressions) pass the
sqlite3ExprIsConstantNotJoin() test. It is not sufficient to pass just the
sqlite3ExprIsConstant() test as that would allow through column references
that are bound to constants by the WHERE clause in the constant propagation
optimization.  This fixes a problem discovered by OSSFuzz.

FossilOrigin-Name: 8bc7f84c39f913b0b0f5e9f5fd9d7dd8bda8422248c069712b6992c32c759a83

6 years agoRemove additional traces of the column cache.
drh [Sat, 4 Aug 2018 14:30:21 +0000 (14:30 +0000)] 
Remove additional traces of the column cache.

FossilOrigin-Name: db6052e9725368736abd19f14f97376582d35d07f543046d39991d767ed29851

6 years agoCompletely remove the column cache logic, which has been a persistent source
drh [Fri, 3 Aug 2018 23:04:16 +0000 (23:04 +0000)] 
Completely remove the column cache logic, which has been a persistent source
of bugs for many years.  We recent enhancements to the performance of the
OP_Column opcode, the removing the column cache actually makes speed-check.sh
run faster.  It also saves about 1,800 bytes of code space.

FossilOrigin-Name: 3f5f60cd7529330209027fdae8129cca420cec1050eae50a7750d0b715b56972

6 years agoFix the handling of sub-queries with LIMIT clauses by the optimization
dan [Fri, 3 Aug 2018 20:19:52 +0000 (20:19 +0000)] 
Fix the handling of sub-queries with LIMIT clauses by the optimization
activated by compile-time symbol SQLITE_COUNTOFVIEW_OPTIMIZATION.

FossilOrigin-Name: 21235d9a41567897418aa12f7bd6dd8d6ee363147527e1d8fbca14fc83e0f2c9

6 years agoFix the OP_SeekRowid opcode so that it has no type-change side-effects on the
drh [Fri, 3 Aug 2018 15:58:07 +0000 (15:58 +0000)] 
Fix the OP_SeekRowid opcode so that it has no type-change side-effects on the
key register in P3.  This fixes an obcure problem that arises when doing
equi-joins between a table with a TEXT column against another table with
an INTEGER PRIMARY KEY.  The original problem was discovered when OSSFuzz
created such a query and hit an assert() in OP_VerifyTabCol that was
specifically designed to catch these kinds of errors at run-time.

FossilOrigin-Name: fa94b49e02eb6b8fc4acc220ecc2fabef546c65845696758b25965c26b251ea9

6 years agoImprove "PRAGMA vdbe_trace=ON" to always show the key values for the
drh [Fri, 3 Aug 2018 13:56:26 +0000 (13:56 +0000)] 
Improve "PRAGMA vdbe_trace=ON" to always show the key values for the
OP_IdxGT and related opcodes.

FossilOrigin-Name: 0f881955ed173c7c35dfca2d4aeca855858e40bb951e6fb6fedd9a2fff6a5a86

6 years agoIn the command-line shell, always exit if realloc() fails.
drh [Sun, 29 Jul 2018 18:56:35 +0000 (18:56 +0000)] 
In the command-line shell, always exit if realloc() fails.

FossilOrigin-Name: e390023c8e70961661fd9e29674dedacd1b941b6b8d9cd88f8cfa8f787f030f9

6 years agoAdd a small cost penalty to sorting to bias the query planner in favor of
drh [Sat, 28 Jul 2018 21:01:55 +0000 (21:01 +0000)] 
Add a small cost penalty to sorting to bias the query planner in favor of
plans that do not require a final sorting pass.

FossilOrigin-Name: 85b9beb4605eb0cfe2ed063c2a1925186c9e37031f78c875e60a347cce891638

6 years agoDo not allow a column reference that is converted into a constant by the
drh [Sat, 28 Jul 2018 16:24:08 +0000 (16:24 +0000)] 
Do not allow a column reference that is converted into a constant by the
WHERE-clause constant propagation optimization to be moved to the init-time
constant expression list, as the table reference will not work there.
This fixes a problem found by OSSFuzz.

FossilOrigin-Name: d30b2a947313b146f29e2b53f0fd471409fda7938151241d3fb5863614f88999

6 years agoFix an assert() statement that was made obsolete by the constant
drh [Sat, 28 Jul 2018 14:56:56 +0000 (14:56 +0000)] 
Fix an assert() statement that was made obsolete by the constant
propagation enhancement.  Problem discovered by OSSFuzz.

FossilOrigin-Name: e4b4737e348235e196a45e1b71876b82e0cc836e1c5c16ea5f9333b7509b59b8

6 years agoImproved debugging output when the ".selecttrace" option is used in the shell.
drh [Sat, 28 Jul 2018 14:34:22 +0000 (14:34 +0000)] 
Improved debugging output when the ".selecttrace" option is used in the shell.

FossilOrigin-Name: fcb88dd6b0f248f600c1158907889f6d5fa2c96eb4585221941da4673c6db6eb

6 years agoImprovements to the parser to increase coverage. Fix the parser so that
drh [Fri, 27 Jul 2018 23:33:16 +0000 (23:33 +0000)] 
Improvements to the parser to increase coverage.  Fix the parser so that
at least one expresssion is required after PARTITION BY and within the
list of expressions on VALUES().

FossilOrigin-Name: 02204f8b246c868846f39bd44f2e3bc0fab0275aa09ef3a0e5a8e3d58f484ca8

6 years agoWhen doing a DROP VIEW do not try to delete entries from the sqlite_stat1
drh [Fri, 27 Jul 2018 22:55:58 +0000 (22:55 +0000)] 
When doing a DROP VIEW do not try to delete entries from the sqlite_stat1
table as there are none.

FossilOrigin-Name: 7efdba2bbc8547ee9292a1bbd1e61d38b40d7aabc0860ceba188bdec539f5114

6 years agoMinor grammar changes that help the parser run faster by reducing the
drh [Fri, 27 Jul 2018 22:14:50 +0000 (22:14 +0000)] 
Minor grammar changes that help the parser run faster by reducing the
number of NUL rule reductions.

FossilOrigin-Name: cfd1b00592bd550e444dfc7b6a6a93c77c07b835729c6cc69a4b6361038964ba

6 years agoEnhance Makefile for MSVC to support building the shell tool without using the amalga...
mistachkin [Fri, 27 Jul 2018 20:45:28 +0000 (20:45 +0000)] 
Enhance Makefile for MSVC to support building the shell tool without using the amalgamation.

FossilOrigin-Name: 3d815d83a6805938b87e03ffabe6d71ca2ecfd05052e8e02c6cc5d3c9ea4ddf3

6 years agoThe WHERE-clause constant propagation optimization attempts to use
drh [Fri, 27 Jul 2018 20:37:42 +0000 (20:37 +0000)] 
The WHERE-clause constant propagation optimization attempts to use
transitive laws to replace column values with constants in the WHERE
clause in order to help to query planner make more aggressive optimizations.

FossilOrigin-Name: f4229707ac08d66c5b0f53483ce17a63f5ac40a21922f66c3408e1b6fda3a7c2

6 years agoReduce the performance cost of the constant propagation optimization to propagate-const-opt
drh [Fri, 27 Jul 2018 20:01:00 +0000 (20:01 +0000)] 
Reduce the performance cost of the constant propagation optimization to
less than 200,000 cycles.

FossilOrigin-Name: 865249de683e6971984a645a30d96f9fcc6f6d9d7af7e269ff68cc3e42e5fe71

6 years agoPerformance improvement to sqlite3ExprCollSeq(). With this change, the
drh [Fri, 27 Jul 2018 18:19:12 +0000 (18:19 +0000)] 
Performance improvement to sqlite3ExprCollSeq().  With this change, the
performance of speed-check.sh is within 400,000 cycles of trunk.

FossilOrigin-Name: a5f86f49b7d9e52546f234f7c3bcbac6b0f78aa55a71c44ca69e21bc31139f3e

6 years agoFaster implementation of sqlite3IsBinary().
drh [Fri, 27 Jul 2018 18:12:40 +0000 (18:12 +0000)] 
Faster implementation of sqlite3IsBinary().

FossilOrigin-Name: be05d0db09f43cc3362c28273463d1d236af737a4f8a494cf1050da07ed0df47

6 years agoOnly run the constant propagation optimization on joins since that is the
drh [Fri, 27 Jul 2018 17:51:20 +0000 (17:51 +0000)] 
Only run the constant propagation optimization on joins since that is the
only scenario where it is useful.  This saves prepare time for the common
case of a simple query.

FossilOrigin-Name: 598d608359005b13fa1151c6c69f2fd12ef3ab7f563a035fc4a6f3c569dc6c67

6 years agoConstant propagation is now restricted to just the WHERE clause. The
drh [Fri, 27 Jul 2018 16:57:11 +0000 (16:57 +0000)] 
Constant propagation is now restricted to just the WHERE clause. The
mechanism is changed to take affinity and collation into account.  This
seems to give correct answers.  But the search for constant propagation
costs 4 million cycles in the speed test.

FossilOrigin-Name: 82c67efb723dba387964f690cd459b420e59e3367d9589016597a76531596391

6 years agoAdd a test case demonstrating the collation problem with constant propagation.
drh [Thu, 26 Jul 2018 23:54:19 +0000 (23:54 +0000)] 
Add a test case demonstrating the collation problem with constant propagation.

FossilOrigin-Name: 50add839fd95665bd67a6ae5de8346fd09e83904bbcbad26fad280dff86d9e93

6 years agoGeneralize the constant propagation optimization so that it applies on every
drh [Thu, 26 Jul 2018 23:47:11 +0000 (23:47 +0000)] 
Generalize the constant propagation optimization so that it applies on every
WHERE close, not just those that contain a subquery.  This then demonstrates
that the current implementation is inadequate since it does not take into
account collating sequences.

FossilOrigin-Name: 57eb2abd5b270d65be5e0f138f0d46899fa6091df3ba20b0ea7ef04244a15d48

6 years agoIn the unix VFS, give every unixInodeInfo object its own mutex, rather
drh [Thu, 26 Jul 2018 21:48:05 +0000 (21:48 +0000)] 
In the unix VFS, give every unixInodeInfo object its own mutex, rather
than using the global VFS mutex, to improve concurrency in cases where there
are many threads operating on separate database files.

FossilOrigin-Name: 22f47cf430827c50634794a5a33987511bb71492c0dd1f6466a0c5b779d0521b

6 years agoInitial implementation of the WHERE-clause constant propagation optimization.
drh [Thu, 26 Jul 2018 21:16:53 +0000 (21:16 +0000)] 
Initial implementation of the WHERE-clause constant propagation optimization.

FossilOrigin-Name: 2fb82ad8ebb6434438c0d235b1239444fb08c8711cea2c5a9ed955fedd0acdec

6 years agoFix a buffer overread in fts5.
dan [Wed, 25 Jul 2018 15:25:55 +0000 (15:25 +0000)] 
Fix a buffer overread in fts5.

FossilOrigin-Name: 0e3de8abbb0c7ae64e637776cb055ce79736f99a103e00e44d17a6b091b98c81

6 years agoKeep generated opcode values grouped together when required, even when they do not...
mistachkin [Wed, 25 Jul 2018 15:12:29 +0000 (15:12 +0000)] 
Keep generated opcode values grouped together when required, even when they do not correspond to a token.

FossilOrigin-Name: 6ee2950b272ede475e485bfaa7d413eaa81482fe9dd6452aeeaf95ff7938f7da

6 years agoFix a typo in the documentation for sqlite3_snapshot_get().
dan [Wed, 25 Jul 2018 07:29:20 +0000 (07:29 +0000)] 
Fix a typo in the documentation for sqlite3_snapshot_get().

FossilOrigin-Name: cd9713c9a88cd30887c67f477abbbf8ef90299051a0b9bb52a04cf4132987c9c

6 years agoDo not abort running queries due to a CREATE INDEX statement. Allow them
drh [Tue, 24 Jul 2018 22:02:12 +0000 (22:02 +0000)] 
Do not abort running queries due to a CREATE INDEX statement.  Allow them
to run to completion before being reprepared.  Fix for ticket
[c694113e50321afdf9].

FossilOrigin-Name: 2bd593332da0aade467e7a4ee89e966aa6302f37540a2c5e23671f98a6cb599c

6 years agoAdd missing SQLITE_OMIT_WINDOWFUNC check to the json1 extension.
mistachkin [Tue, 24 Jul 2018 13:57:44 +0000 (13:57 +0000)] 
Add missing SQLITE_OMIT_WINDOWFUNC check to the json1 extension.

FossilOrigin-Name: fe19f8239dc474db0854a0a8ce5189ac4195c736b496f475a59a185e0879b40c

6 years agoReturn an SQLITE_NOMEM error if the locking mutex fails to allocate. separate-lock-mutex
drh [Mon, 23 Jul 2018 22:55:10 +0000 (22:55 +0000)] 
Return an SQLITE_NOMEM error if the locking mutex fails to allocate.

FossilOrigin-Name: 1c94834879be0601ac40ef3c4fb1b140f7737e89af7808f2f1db4ceb3daae19f

6 years agoFirst attempt at reducing mutex contention in the unix VFS by providing
drh [Mon, 23 Jul 2018 21:10:37 +0000 (21:10 +0000)] 
First attempt at reducing mutex contention in the unix VFS by providing
a separate mutex for each unixInodeInfo object.

FossilOrigin-Name: f69afaf00a659cd768a863c5f4a1d527f01187e037240da0ada527cb52c5afe8

6 years agoFix typo of 'SQLITE_OMIT_WINDOWFUNC'.
mistachkin [Mon, 23 Jul 2018 18:53:49 +0000 (18:53 +0000)] 
Fix typo of 'SQLITE_OMIT_WINDOWFUNC'.

FossilOrigin-Name: 8607b84a5c53d8c9218c90802160a3000f1138b1f188e411a3af46253e0a69cc

6 years agoAttempt to improve the documentation for snapshots. No changes to code.
drh [Mon, 23 Jul 2018 18:32:42 +0000 (18:32 +0000)] 
Attempt to improve the documentation for snapshots.  No changes to code.

FossilOrigin-Name: 46dd076af5880e6e9a7de974758b26bc43d0dc074f8143234038fa9cdcc726ee

6 years agoFix the macros used to generate the output of "PRAGMA compile_options" so that
dan [Mon, 23 Jul 2018 10:57:53 +0000 (10:57 +0000)] 
Fix the macros used to generate the output of "PRAGMA compile_options" so that
they handle valid values for the SQLITE_DEFAULT_LOOKASIDE macro (which
contain a "," character).

FossilOrigin-Name: 1cc72845f92198f2f6c1d34957921cd8f5bc82eaccab9f844006993f0b8d7a96

6 years agoFix more harmless compiler warnings seen with MSVC.
mistachkin [Sun, 22 Jul 2018 21:23:19 +0000 (21:23 +0000)] 
Fix more harmless compiler warnings seen with MSVC.

FossilOrigin-Name: edab5666f8470b37e6031dfd80e615b1aab95d1d85ccbe4ece1a813f8b3d4d95

6 years agoAnother minor revision to the 'fulltestonly' set of tests.
mistachkin [Sun, 22 Jul 2018 21:08:35 +0000 (21:08 +0000)] 
Another minor revision to the 'fulltestonly' set of tests.

FossilOrigin-Name: 61f8e2a4c6c146ffba498c8bb40f2b5627fdc14020057eab63b7e900bf88a9ed

6 years agoFix harmless compiler warning.
mistachkin [Sun, 22 Jul 2018 20:24:38 +0000 (20:24 +0000)] 
Fix harmless compiler warning.

FossilOrigin-Name: ead4762dfcd284127e60483e14f88aa4f4f034c2e1efb68a150359ba8f307776

6 years agoIn the Win32 VFS, when truncating a file, unmap it first.
mistachkin [Sun, 22 Jul 2018 06:25:35 +0000 (06:25 +0000)] 
In the Win32 VFS, when truncating a file, unmap it first.

FossilOrigin-Name: 21510a66dce4d0843ccfe20f092a01f5a52563ef244a94f1d5d2563305cab925

6 years agoRemove an unused branch in the FK logic. dropViewNoStat
drh [Sun, 22 Jul 2018 00:45:11 +0000 (00:45 +0000)] 
Remove an unused branch in the FK logic.

FossilOrigin-Name: 523ff77925f1da361cf31e3fc82bcb1708ed356a2391430ab14ef620c9bf2327

6 years agoIn 'resetdb.test', close a database prior to trying to delete it.
mistachkin [Sat, 21 Jul 2018 23:15:55 +0000 (23:15 +0000)] 
In 'resetdb.test', close a database prior to trying to delete it.

FossilOrigin-Name: 45137053a511b976f5447b0668e3f3a636785d242f44b110a1107898e847e95e

6 years agoWhen dropping a view, skip trying to delete from 'sqlite_stat*'.
mistachkin [Fri, 20 Jul 2018 20:56:22 +0000 (20:56 +0000)] 
When dropping a view, skip trying to delete from 'sqlite_stat*'.

FossilOrigin-Name: 2f5be3a2ddf469bd1b37b9e357545ce872b90c479a07094de2101d0a43ad70a4

6 years agoChange the SQLITE_Stat34 bit of the optimization test-control so that it
drh [Fri, 20 Jul 2018 19:24:02 +0000 (19:24 +0000)] 
Change the SQLITE_Stat34 bit of the optimization test-control so that it
prevents STAT4 data from being used but allows it to be loaded into the
Index objects.  This permits STAT4 to be turned on and off on a per-statement
basis.

FossilOrigin-Name: 489f3caf5dcc8cace20a0da58ceb32fdea5770ba570fa3c9f712cd35e726846a

6 years agoNew checked in PRAGMA integrity_check to validate the autovacuum settings
drh [Fri, 20 Jul 2018 15:44:09 +0000 (15:44 +0000)] 
New checked in PRAGMA integrity_check to validate the autovacuum settings
in the header.

FossilOrigin-Name: a4663f09c91d1381a831f61a2b8e8a113eb6083932c4aea2ad0c011ece1418c5

6 years agoEnhanced detection of problems on the freelist and on overflow list in
drh [Fri, 20 Jul 2018 13:39:28 +0000 (13:39 +0000)] 
Enhanced detection of problems on the freelist and on overflow list in
PRAGMA integrity_check.

FossilOrigin-Name: 11e58f5b37d99848978007d834d187c262d904eb9d58924742e028d7cb324e64

6 years agoAvoid a branch in the commit logic that is unreachable when compiled
drh [Thu, 19 Jul 2018 15:27:35 +0000 (15:27 +0000)] 
Avoid a branch in the commit logic that is unreachable when compiled
without SQLITE_ENABLE_BATCH_ATOMIC_WRITE.

FossilOrigin-Name: 271b8980c3bcd0403a40aec26681ec111be1d88d2d5d35199a85a10f09ad6920

6 years agoAllow the VACUUM following SQLITE_DBCONFIG_RESET_DATABASE to proceed even
drh [Thu, 19 Jul 2018 14:40:41 +0000 (14:40 +0000)] 
Allow the VACUUM following SQLITE_DBCONFIG_RESET_DATABASE to proceed even
if the write-version in the header indicates that the database file is not
writable.

FossilOrigin-Name: 3dca8b9d5ab1f35f17fc527d8f2a20b6bac989d1406c883d5b4d6719953ef6b4

6 years agoExperimental fix for resetting databases that have been deemed read-only due exp-dbreset-fix
dan [Thu, 19 Jul 2018 11:44:02 +0000 (11:44 +0000)] 
Experimental fix for resetting databases that have been deemed read-only due
to a corrupt "read-version" header field.

FossilOrigin-Name: e2394002d02754bb45d56e805df9bc5a2ef0d14e5d94262c1f8ab7643bc27c8f

6 years agoAdd the SQLITE_FCNTL_DATA_VERSION file control
drh [Wed, 18 Jul 2018 19:09:07 +0000 (19:09 +0000)] 
Add the SQLITE_FCNTL_DATA_VERSION file control

FossilOrigin-Name: a5087c5c87ad65f92e3bc96bbc84afb43faf10ab6b9ed3ba16304b5c60ad069f

6 years agoFix a harmless compiler warning in the pager. Enhance the docs for
drh [Wed, 18 Jul 2018 17:37:51 +0000 (17:37 +0000)] 
Fix a harmless compiler warning in the pager.  Enhance the docs for
sqlite3_changes() and sqlite3_total_changes() to refer to the data_version
pragma.

FossilOrigin-Name: 4c70ea5b0e2a512c6a46ac1f14397720e8c8556875701e78c30b19f850c24f55

6 years agoIf an SQLITE_IOERR error is encountered as part of an atomic commit on an F2FS file...
dan [Tue, 17 Jul 2018 14:01:55 +0000 (14:01 +0000)] 
If an SQLITE_IOERR error is encountered as part of an atomic commit on an F2FS file-system, retry the commit in legacy journal mode.

FossilOrigin-Name: 2e0357c2ed30927921cd17129e348a18a6f3fd086d1fc0a42756036b321a084d

6 years agoFix for builds without SQLITE_ENABLE_BATCH_ATOMIC_WRITE. exp-retry-atomic-commit
dan [Tue, 17 Jul 2018 13:55:08 +0000 (13:55 +0000)] 
Fix for builds without SQLITE_ENABLE_BATCH_ATOMIC_WRITE.

FossilOrigin-Name: b10ec14ef7edcc5d7b0ad298c8230d1eca5508e8cf673fbbc97a0928b76c92fb

6 years agoAdd new file doc/F2FS.txt, containing notes on the way SQLite uses the F2FS atomic...
dan [Mon, 16 Jul 2018 20:44:00 +0000 (20:44 +0000)] 
Add new file doc/F2FS.txt, containing notes on the way SQLite uses the F2FS atomic commit feature.

FossilOrigin-Name: 59efb1bfaba12742379aae45c8c796ca539f089af9e553a3a55d6899a9c583c8

6 years agoMinor simplification to sqlite3RollbackAll().
drh [Mon, 16 Jul 2018 11:32:59 +0000 (11:32 +0000)] 
Minor simplification to sqlite3RollbackAll().

FossilOrigin-Name: 432fdc221550b3cca4140b1ae411da22201f689c30c72c5472dfdbc79bec9d90