aboutsummaryrefslogtreecommitdiff
path: root/sqlite3.go (follow)
Commit message (Collapse)AuthorAgeFilesLines
...
* Adds GetFilename (sqlite3_db_filename) to SqliteConnZachary Gramana2018-06-121-0/+11
|
* Merge pull request #586 from mattn/feature/userauthmattn2018-06-081-2/+185
|\ | | | | Feature/userauth
| * ADD: User Authentication Password EncodersGert-Jan Timmer2018-06-051-0/+58
| | | | | | Allow user to choose how to encode passwords with connection string overrides of embedded `sqlite_crypt` function.
| * Implemented goconvey for User Authentication TestsGert-Jan Timmer2018-06-041-5/+5
| | | | | | Reference #580
| * Update User AuthenticationGert-Jan Timmer2018-06-011-12/+18
| | | | | | | | | | | | * Update bindings * Add user authentication sql functions Reference #579
| * StashGert-Jan Timmer2018-05-311-4/+4
| | | | | | [ci skip]
| * UPD: User AuthenticationGert-Jan Timmer2018-05-311-8/+2
| | | | | | | | | | Implemented table check; only activate User Authentication on a database which has no UA enabled. Closes #582
| * ADD: User authenticationGert-Jan Timmer2018-05-301-2/+127
| | | | | | | | | | | | | | | | * User Authentication Implementation * Rename file to conform to fileformat `sqlite3_*_omit.go` * Updated sqlite3-binding.* with new upgrade tool * Add: callbackRetNil required for error type return because of adding `RegisterFunc`s directly on the connection. * Add: TestCreateAuthDatabase
* | Add nil check in bind and a testLucas Manuel Rodriguez2018-05-301-4/+8
|/
* Fix: Display of secure_delete error messageGert-Jan Timmer2018-05-291-1/+1
|
* Fix: Condition of queryOnly VariableGert-Jan Timmer2018-05-291-1/+1
|
* Fix: Connection DSN KeysGert-Jan Timmer2018-05-291-11/+40
| | | | | | | | * Conform keys to match PRAGMA * UPD: README * Fix error of _auto_vacuum * Fix error of _case_sensitive_like * Fix error of _locking_mode * Fix error of _secure_delete
* ADD: PRAGMA writable_schemaGert-Jan Timmer2018-05-291-4/+35
|
* ADD: PRAGMA synchronousGert-Jan Timmer2018-05-291-1/+40
|
* Add: PRAGMA secure_deleteGert-Jan Timmer2018-05-291-0/+34
| | | | ADD: Connection PRAGMA ADD: Build tag for secure_delete mode: FAST
* ADD: PRAGMA query_onlyGert-Jan Timmer2018-05-291-0/+27
|
* Add: Documentation for opening as ImmutableGert-Jan Timmer2018-05-291-0/+9
|
* ADD: PRAGMA locking_modeGert-Jan Timmer2018-05-291-1/+28
|
* ADD: PRAGMA journal_modeGert-Jan Timmer2018-05-291-0/+25
|
* Fix: String ToLower for PRAGMA'sGert-Jan Timmer2018-05-291-4/+5
|
* Update READMEGert-Jan Timmer2018-05-291-0/+17
| | | | | | ADD: Comments for SQLite Access Mode ADD: Comments for SQLite Shared-Cache Mode UPD: README * Add Access Mode in Connection String Table
* ADD: Additional Copyright lineGert-Jan Timmer2018-05-291-0/+1
|
* Update CommentsGert-Jan Timmer2018-05-291-3/+3
|
* ADD: PRAGMA ignore_check_constraintsGert-Jan Timmer2018-05-291-0/+28
|
* Update CommentsGert-Jan Timmer2018-05-291-0/+1
|
* ADD: PRAGMA defer_foreign_keysGert-Jan Timmer2018-05-291-0/+34
|
* Update Recursive TriggersGert-Jan Timmer2018-05-291-1/+8
| | | ADD: Multiple Key
* Fix: pkeyGert-Jan Timmer2018-05-291-3/+5
| | | Ensure pkey is empty for next condition
* Update Foreign Keys PRAGMAGert-Jan Timmer2018-05-291-4/+9
| | | ADD: Multiple key
* Update Busy Timeout PRAGMAGert-Jan Timmer2018-05-291-1/+10
| | | ADD: multiple key
* ADD: PRAGMA case_sensitive_likeGert-Jan Timmer2018-05-291-8/+47
| | | | ADD: Comments UPD: README
* Update Connection OptionsGert-Jan Timmer2018-05-291-42/+81
| | | | | | | | | | * Rewrite order of options * ADD: PRAGMA auto_vacuum * ADD: Multi Boolean values * UPD: README * FIX: Case-Sensitive values * Reduced code for: - foreign_keys - recursive_triggers
* fmt updateGert-Jan Timmer2018-05-271-5/+9
| | | | | | Fix: Placed all +build tags in the same location Fix: Split CFLAGS, LDFLAGS into seperate lines for readability and lookup Fix: Placed empty line between copyright comments and build tags for readability Fix: Placed OS specfic cgo flags at the end if the cgo sections contains multiple lines.
* Merge branch 'master' into fix/walmattn2018-05-241-0/+2
|\
| * Merge pull request #564 from GJRTimmer/fix/213mattn2018-05-241-0/+1
| |\ | | | | | | Fix #213
| | * ADD: SQLITE_ENABLE_UPDATE_DELETE_LIMITGert-Jan Timmer2018-05-231-0/+1
| | | | | | | | | Fixes #213
| * | ADD: SQLITE_OMIT_DEPRECATEDGert-Jan Timmer2018-05-231-0/+1
| |/
* / ADD: SQLITE_DEFAULT_WAL_SYNCHRONOUSGert-Jan Timmer2018-05-231-0/+1
|/
* Merge pull request #540 from mattn/open-modemattn2018-04-191-3/+16
|\ | | | | add _mutex flag to specify SQLITE_OPEN_NOMUTEX or SQLITE_OPEN_FULLMUTEX
| * add _mutex flag to specify SQLITE_OPEN_NOMUTEX or SQLITE_OPEN_FULLMUTEXYasuhiro Matsumoto2018-03-161-3/+16
| |
* | disable pread64/pwrite64 on androidYasuhiro Matsumoto2018-04-181-1/+1
| |
* | Merge pull request #549 from mjtrangoni/fix-linter-issuesmattn2018-04-171-9/+15
|\ \ | |/ |/| Fix linter issues
| * fix all goconst issuesMario Trangoni2018-04-171-2/+8
| |
| * fix all unconvert issuesMario Trangoni2018-04-171-7/+7
| |
* | Merge pull request #530 from navytux/y/no-go-if-notneededmattn2018-02-181-19/+23
|\ \ | | | | | | Don't spawn interrupt goroutine if we know that context cannot be canceled
| * | Don't spawn interrupt goroutine if we know that context cannot be canceledKirill Smelkov2018-02-171-19/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | For a Go-only project the following code pattern go func() { select { case <-ctx.Done(): // call some cancel case <-done: // work finished ok } }() // do some work close(done) works good and fast - without high scheduling overhead because scheduler usually puts spawned goroutine into run queue on the same OS thread and so after done is closed control is passed to spawned goroutine without OS context switch. However in the presence of Cgo calls in "do some work" the situation can become different - Cgo calls are treated by go runtime similarly to system calls with the effect that goroutines spawned on original OS thread tend to be migrated by scheduler to be executed on another OS thread. This in turn can bring high overhead for communicating on "done", which ultimately can result in full context switch: if the spawned goroutine had chance to run, already checked done and ctx to be not ready, and went into sleep via wait on futex - showing as something like below in strace for one read query (note futex calls): 27867 00:38:39.782146 stat(".../neo.sqlite-journal", 0x7f83809c4a20) = -1 ENOENT (No such file or directory) 27867 00:38:39.782165 pread64(3, "\0\0\0\33\0\0\10\235\0\0\10]\0\0\0\27", 16, 24) = 16 27871 00:38:39.782179 <... pselect6 resumed> ) = 0 (Timeout) 27868 00:38:39.782187 <... pselect6 resumed> ) = 0 (Timeout) 27871 00:38:39.782193 futex(0xc4200f8538, FUTEX_WAIT, 0, NULL <unfinished ...> 27868 00:38:39.782199 futex(0xc420013138, FUTEX_WAIT, 0, NULL <unfinished ...> 27867 00:38:39.782205 stat(".../neo.sqlite-wal", 0x7f83809c4a20) = -1 ENOENT (No such file or directory) 27867 00:38:39.782224 fstat(3, {st_mode=S_IFREG|0644, st_size=9031680, ...}) = 0 27867 00:38:39.782247 futex(0xc420013138, FUTEX_WAKE, 1 <unfinished ...> 27868 00:38:39.782259 <... futex resumed> ) = 0 27867 00:38:39.782265 <... futex resumed> ) = 1 27868 00:38:39.782270 pselect6(0, NULL, NULL, NULL, {tv_sec=0, tv_nsec=3000}, NULL <unfinished ...> 27867 00:38:39.782279 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=0, l_len=0}) = 0 27867 00:38:39.782315 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1}) = 0 27868 00:38:39.782336 <... pselect6 resumed> ) = 0 (Timeout) 27867 00:38:39.782342 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741826, l_len=510} <unfinished ...> 27868 00:38:39.782348 futex(0xc4200f8538, FUTEX_WAKE, 1 <unfinished ...> 27867 00:38:39.782355 <... fcntl resumed> ) = 0 27871 00:38:39.782360 <... futex resumed> ) = 0 27868 00:38:39.782367 <... futex resumed> ) = 1 27871 00:38:39.782372 futex(0xc4200f8138, FUTEX_WAKE, 1 <unfinished ...> 27868 00:38:39.782377 pselect6(0, NULL, NULL, NULL, {tv_sec=0, tv_nsec=3000}, NULL <unfinished ...> 27871 00:38:39.782384 <... futex resumed> ) = 1 27870 00:38:39.782389 <... futex resumed> ) = 0 27867 00:38:39.782394 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1} <unfinished ...> 27870 00:38:39.782400 pselect6(0, NULL, NULL, NULL, {tv_sec=0, tv_nsec=3000}, NULL <unfinished ...> 27867 00:38:39.782408 <... fcntl resumed> ) = 0 Below link shows that go scheduler itself might be significantly improved for cases when there are several Cgo calls made for a request in a server: https://github.com/golang/go/issues/21827#issuecomment-329092317 in particular CGo-4 case should be closely related to this sqlite3 go package, because for one query many CGo calls are made to SQLite. However until there are proper scheduler fixes, let's make what could be made to improve time to do queries: If we know that the context under which a query is executed will never be canceled - we know we can safely skip spawning the interrupt goroutine and this was avoid ping-pong on done in between different OS threads. This brings the following speedup on my notebook with go1.10: name old req/s new req/s delta Exec 254k ± 1% 379k ± 1% +48.89% (p=0.000 n=10+10) Query 90.6k ± 2% 96.4k ± 1% +6.37% (p=0.000 n=10+10) Params 81.5k ± 1% 87.0k ± 1% +6.83% (p=0.000 n=10+10) Stmt 122k ± 2% 129k ± 1% +6.07% (p=0.000 n=10+9) Rows 2.98k ± 1% 3.06k ± 1% +2.77% (p=0.000 n=9+10) StmtRows 3.10k ± 1% 3.13k ± 1% +1.12% (p=0.000 n=9+10) name old time/op new time/op delta CustomFunctions-4 10.6µs ± 1% 10.1µs ± 1% -5.01% (p=0.000 n=10+10)
* | | only enable pread/pwrite for linux. fixes #533 and fixes #532Bas van Beek2018-02-171-1/+2
| | |
* | | Let SQLite use pread/pwriteKirill Smelkov2018-02-161-1/+1
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | With current settings SQLite was using lseek/read syscalls to read data, e.g.: 20:43:17.640660 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=0, l_len=0}) = 0 20:43:17.640683 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1}) = 0 20:43:17.640705 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741826, l_len=510}) = 0 20:43:17.640725 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1}) = 0 20:43:17.640744 stat(".../neo.sqlite-journal", 0x7ffef2c91080) = -1 ENOENT (No such file or directory) 20:43:17.640764 lseek(3, 24, SEEK_SET) = 24 20:43:17.640779 read(3, "\0\0\0\33\0\0\10\235\0\0\10]\0\0\0\27", 16) = 16 20:43:17.640795 stat(".../neo.sqlite-wal", 0x7ffef2c91080) = -1 ENOENT (No such file or directory) but if we allow it to use pread it will be only 1 system call instead of 2 and reading this way can also be done in parallel because there is no global to file seeking: 20:48:42.668466 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=0, l_len=0}) = 0 20:48:42.668501 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1}) = 0 20:48:42.668522 fcntl(3, F_SETLK, {l_type=F_RDLCK, l_whence=SEEK_SET, l_start=1073741826, l_len=510}) = 0 20:48:42.668542 fcntl(3, F_SETLK, {l_type=F_UNLCK, l_whence=SEEK_SET, l_start=1073741824, l_len=1}) = 0 20:48:42.668561 stat(".../neo.sqlite-journal", 0x7ffdbc1f22c0) = -1 ENOENT (No such file or directory) 20:48:42.668580 pread64(3, "\0\0\0\33\0\0\10\235\0\0\10]\0\0\0\27", 16, 24) = 16 20:48:42.668597 stat(".../neo.sqlite-wal", 0x7ffdbc1f22c0) = -1 ENOENT (No such file or directory) (if needed this enablement can be done per OS)
* | Merge pull request #525 from mattn/add-usleepmattn2018-02-071-1/+1
|\ \ | | | | | | add -DHAVE_USLEEP=1
| * | add -DHAVE_USLEEP=1Yasuhiro Matsumoto2018-02-071-1/+1
| | | | | | | | | | | | fixes #211
generated by cgit v1.2.3 (git 2.50.1) at 2025-12-16 17:55:36 +0000