cartodb4/cartodb-postgresql
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,110 Commits 1 Branch 92 Tags
2e1fe2933cb29d2e69d126ef01acac68ce5ceecc
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Javier Goizueta 2e1fe2933c Fix whitespace 2019-07-03 16:56:29 +02:00
Javier Goizueta 5963c67376 Order the columns of a cartodbfied table consistently 
The final order of the columns of a cartodbfied table wasn't uniquely specified, so could vary across PG versions.
This was a problem in particular for having deterministic test results.
 2019-07-03 16:16:37 +02:00
Javier Goizueta f5f18ca57c Fix the order of the columns 2019-07-02 18:14:18 +02:00
Javier Goizueta d8c840d126 Quote table and column names when necessary 
Also use type NAME when appropriate. Note that quoted column names are not NAMES (may be longer).
 2019-07-02 18:14:04 +02:00
Javier Goizueta 65483743b4 Remove unused vars 2019-07-02 17:44:06 +02:00
Javier Goizueta 4651883454 Fix order of test results 2019-07-02 17:43:13 +02:00
Javier Goizueta 470bae6268 Merge branch 'master' into table-syncer-notmps 
# Conflicts:
#	scripts-available/CDB_SyncTable.sql
 2019-07-02 12:21:49 +02:00
Javier Goizueta 75ba13b834 Merge pull request #364 from CartoDB/synctable-doc 
Document CDB_SyncTable
 2019-07-02 10:20:24 +02:00
Javier Goizueta 057695361d Fix typo 2019-07-01 17:49:42 +02:00
Javier Goizueta 0e1aeb0a76 Minor copy edit 2019-07-01 17:00:22 +02:00
Javier Goizueta f2dae651b3 More complete sync table example 2019-07-01 16:58:24 +02:00
Javier Goizueta 9f414938ba Document CDB_SyncTable 2019-07-01 16:41:40 +02:00
Javier Goizueta 4f7b07f922 Merge pull request #363 from CartoDB/fix-sync-schema 
Fix cartodb schema references
 2019-07-01 16:15:25 +02:00
Javier Goizueta 69cc56b589 Remove schema from public function examples 2019-07-01 15:13:48 +02:00
Javier Goizueta 1028b24333 Fix cartodb schema references 2019-07-01 14:48:42 +02:00
Javier Goizueta 4d1c4f6a22 Release 0.28.0 2019-07-01 10:56:06 +02:00
Javier Goizueta 83ab128a01 Merge pull request #355 from CartoDB/table-syncer 
[WIP] Table syncer
 2019-07-01 10:49:06 +02:00
Javier Goizueta 4f4df2de8d Merge branch 'table-syncer' into table-syncer-notmps 2019-06-28 15:28:06 +02:00
Javier Goizueta b5f36902c5 Merge branch 'master' into table-syncer 2019-06-28 13:50:46 +02:00
Javier Goizueta 0bcbf6708a Remove usage of temporary tables 2019-06-28 13:49:15 +02:00
Javier Goizueta 7760d6b30d Release 0.23.1 2018-07-19 17:11:56 +02:00
Javier Goizueta 4515c8547e Merge pull request #334 from CartoDB/333-parallel-unsafe 
Fix PARALLEL tags
 2018-07-19 16:57:22 +02:00
Javier Goizueta 2766bbc83a Fix PARALLEL tags 
Fixes #333
 2018-07-18 12:13:31 +02:00
Javier Goizueta c1c55bf59f Release 0.21.0 2018-02-15 17:22:42 +01:00
Javier Goizueta 0a58c05049 Merge pull request #323 from CartoDB/321-grant-sequence 
grant usage on cartodb_id sequence when sharing read write
 2018-02-15 16:29:25 +01:00
Javier Goizueta 81f2fad3ad Merge pull request #322 from CartoDB/max-grid-size 
Add limit to the grid-generating functions
 2018-02-15 16:09:12 +01:00
Javier Goizueta 0a0f2e294b Fix tests 2018-02-15 10:27:19 +01:00
Javier Goizueta 7ea428913a Add limit to the grid-generating functions 
This adds an optinal maxcells parameter to the rectangle and hexagonal grids,
with a default value of 262144 (2^18).
An error occurs when the grids would need more cells.
 2018-02-14 17:50:06 +01:00
Javier Goizueta 2d473cf693 New version 0.19.0 2017-04-11 11:22:20 +02:00
Javier Goizueta 4193ff3874 Merge pull request #298 from CartoDB/295-estimate-row-count 
Add CDB_EstimateRowCount function
 2017-04-11 11:01:31 +02:00
Javier Goizueta 68a0752849 Use PG 9.5 for travis tests; fix tests 2017-04-10 15:58:49 +02:00
Javier Goizueta 815b5b429d Fix tests 2017-04-10 13:50:37 +02:00
Javier Goizueta 76bdb3657a Fix tests 2017-04-10 12:17:47 +02:00
Javier Goizueta 234373df11 Replace unnecessary count 2017-04-10 08:08:59 +02:00
Javier Goizueta a486eed2e3 Add CDB_EstimateRowCount function 
See #295
 2017-04-07 15:35:48 +02:00
Javier Goizueta 58e2e7e238 Release 0.18.5 2016-11-30 17:17:45 +01:00
Javier Goizueta 25d27263cb Merge pull request #249 from CartoDB/nullbins 
Test behavior of binning fuctions with nulls
 2016-11-30 16:09:23 +01:00
Javier Goizueta bbadcc838e Merge pull request #244 from CartoDB/equalbins 
Convert CDB_EqualIntervalBins to a single SQL statement and add float version
 2016-11-30 16:09:05 +01:00
Javier Goizueta b1a0904c07 Merge pull request #181 from CartoDB/update_to_cdb_stats 
Fix for division by zero error on empty or homogenous array
 2016-11-30 16:08:40 +01:00
Javier Goizueta 399b680b41 Merge pull request #283 from CartoDB/157-test-fixes 
Fix tests: race condition with publicuser #157
 2016-11-30 16:08:21 +01:00
Javier Goizueta 7c0636c5f9 Merge pull request #290 from CartoDB/286-overview-strategies 
Add point overview strategies
 2016-11-30 11:46:29 +01:00
Javier Goizueta f58f870457 Remove use of first aggregator in sample-cluster overviews strategy 
This is not more efficient but the geometry now corresponds to the cartodb_id
and the dependency with custom aggregators (firt) is removed.
 2016-11-29 14:08:08 +01:00
Javier Goizueta a7c8dc04e3 Release 0.18.4 
This just fixes the lack of migration path from 0.18.2
 2016-11-04 16:25:03 +01:00
Javier Goizueta 90ee56eb35 Merge pull request #288 from CartoDB/fix-migration 
Fix migration script generation
 2016-11-04 16:22:56 +01:00
Javier Goizueta 1032737600 Fix migration script generation 
In the 0.18.3 release the script to migrate from 0.18.2 was missing.
This will generate a new version 0.18.4 that when install will generate
scripts to migrate from all old versions to it, so it will be possible
to migrate existing users to 0.18.4 (but not to 0.18.3)
 2016-11-04 16:19:06 +01:00
Javier Goizueta 24639713f1 Release 0.18.3 
The exclusion of analysis cache tables size from the quota (#281)
was meant to be included in 0.18.0 but missed the release, so
it's being released in this version.
 2016-11-03 16:13:57 +01:00
Javier Goizueta fff7e926c9 Merge pull request #287 from CartoDB/fix-281-merge 
Fix 281 merge
 2016-11-03 16:09:02 +01:00
Javier Goizueta 7d7ecc06f5 Merge branch 'master' into fix-281-merge 2016-11-03 15:57:24 +01:00
Javier Goizueta 5992304b47 Add a couple of overview clustering strategies 2016-11-03 13:31:04 +01:00
Javier Goizueta 1356131ec1 Fix tests 2016-10-14 11:22:06 +02:00
Javier Goizueta 9731ce38ec Exclude configuration tables from the quota 
cdb_tablemetadata was already being excluded, but not cdb_conf and cdb_analysis_catalog
 2016-10-14 10:58:16 +02:00
Javier Goizueta 07892271e5 Exclude analysis cache tables from the quota 
See #277
 2016-10-14 10:56:14 +02:00
Javier Goizueta 066c574709 Fix: cdb_conf table is not accessible to regular users 2016-10-11 17:52:11 +02:00
Javier Goizueta 4786e0a2ae Test cleanup 2016-10-11 17:49:50 +02:00
Javier Goizueta 358c89b332 Add tests for CDB_CheckAnalysisQuota() 2016-10-11 16:35:08 +02:00
Javier Goizueta fa6f9a8a66 Implement CDB_CheckAnalysisQuota 
see #279
 2016-10-11 15:14:44 +02:00
Javier Goizueta 457b614d96 Exclude null geometries to create overviews 
Fixes #269
 2016-07-05 16:45:12 +02:00
Javier Goizueta 5bf35bddc1 Merge pull request #262 from CartoDB/261-overviews-quota 
Exclude overviews from user data size
 2016-06-20 11:03:56 +02:00
Javier Goizueta 2b69823949 💄 indent/parenthesize for clarity 2016-06-13 10:39:05 +02:00
Javier Goizueta 1f01ecae30 Exclude overviews from user data size 
Fixes #261

Some internal functions from the Overviews module
have been moved to a separate file because they're now
used from Quaota function.
 2016-06-13 10:04:13 +02:00
Javier Goizueta 58fd5d4060 Release 0.16.4 2016-05-30 10:45:12 +02:00
Javier Goizueta a2a1ff6ae8 Merge pull request #258 from CartoDB/257-max-overviews-level 
Fix problems computing feature density for overviews creation
 2016-05-27 16:15:59 +02:00
Javier Goizueta 326aae4edb Merge pull request #259 from CartoDB/zoom_from_scale 
Use standard formula for CDB_ZoomFromScale
 2016-05-27 16:15:42 +02:00
Javier Goizueta 2a30eb2fd3 Fix zoom from scale condition for NULL result 
And rewrite in cleaner form.
 2016-05-27 15:10:20 +02:00
Javier Goizueta 0b3ad5e569 Limit the maximum zoom level 
Avoid returning zoom levels greater than the maximum
'safe' level. For a zero denominator (which would imply
and infinite zoom level) return the maximum level too.
 2016-05-27 12:29:52 +02:00
Javier Goizueta 9526f0448f Fix bug in feature density recursive query 
If the table had x and/or y columns they were picked by an inner
select instead of the recursive arguments.
Fixes #256
 2016-05-26 18:25:11 +02:00
Javier Goizueta 3399f2b9a5 Fix max overviews level usage 
Note that _CDB_Feature_Density_Ref_Z_Strategy returns the first
level for which overviews should not be used, and that in some
cases _CDB_Feature_Density should look beyond the max level to
compute a feature density estimate.
 2016-05-25 14:00:55 +02:00
Javier Goizueta 803b3671d0 Fixes for feature density computation 
* The initial iteration of the recursive feature density query shouldn't
  start beyond the maximum level
* Correct off-by-one limit the rest of iterations
 2016-05-25 11:21:12 +02:00
Javier Goizueta c3fada29a8 Comment how the max overview level is defined 2016-05-25 11:07:06 +02:00
Javier Goizueta 86e5f6d317 Limit the maximum overview level to 23 
Fixes #257

23 = 32 bits per integer - 1 sign bit - 8 bits px/tile
 2016-05-24 18:18:58 +02:00
Javier Goizueta f5f59be5b0 Release version 0.16.3 
Fixes overviews creation problem
 2016-05-09 13:08:50 +02:00
Javier Goizueta d99dc394c2 Merge pull request #253 from CartoDB/252-estimateextent-quoting 
Do not quote arguments to ST_EstimatedExtent
 2016-05-09 13:04:44 +02:00
Javier Goizueta 8d7860dc7a Fixes #252 2016-05-09 11:54:56 +02:00
Javier Goizueta b5427c65c8 Drop aggregate to be defined 
Otherwise future versions will fail to recreate the aggregate
 2016-04-29 08:46:01 +02:00
Javier Goizueta 8f1435c049 Release 0.16.2 2016-04-27 18:30:26 +02:00
Javier Goizueta 8302f89413 Merge pull request #246 from CartoDB/245-categories-mode 
Use the mode to aggregate category columns in overviews
 2016-04-27 18:16:05 +02:00
Javier Goizueta e9050178a8 Merge branch 'master' of github.com:CartoDB/cartodb-postgresql 2016-04-27 16:23:46 +02:00
Javier Goizueta 3e34ca4654 Overviews documentation fixes 2016-04-27 16:23:25 +02:00
Javier Goizueta a067cc7da1 Generate stats used to identify category columns in overviews if needed 
This only generates the stats if no stats are available for a table.
This doesn't warrant that the stats are up to date or accurate.
 2016-04-27 15:06:09 +02:00
Javier Goizueta 2c43943df6 Fix syntax 2016-04-26 18:27:52 +02:00
Javier Goizueta 417cbe7902 Fix category columns aggregation in overviews 
Overviews are created in cascade, each one from the inmediate
lower level, but the stats to decide if a column is a category
should be taken always from the base table.
 2016-04-26 18:02:25 +02:00
Javier Goizueta 9a73703954 Use mode to aggregate categorical columns in overviews 
Fixes #245
 2016-04-26 15:15:24 +02:00
Javier Goizueta 1358964628 Release 0.16.1 2016-04-25 18:47:42 +02:00
Javier Goizueta efe381ad94 Merge pull request #243 from CartoDB/241-webmercator 
Compute webmercator resolution with full accuracy
 2016-04-25 17:30:40 +02:00
Javier Goizueta f7cce21eb7 Merge pull request #242 from CartoDB/240-overviews-pixels 
Adjust overview points to pixel centers
 2016-04-25 17:30:25 +02:00
Javier Goizueta 18267477da Merge pull request #238 from CartoDB/235-column-names 
Optimize column information functions
 2016-04-25 17:30:07 +02:00
Javier Goizueta 11ad45306f Remove unneeded pg_catalog schema name 2016-04-25 16:30:58 +02:00
Javier Goizueta 75c7ae98e4 Compute webmercator resolution with full accuracy 
Fixes #241
 2016-04-25 14:02:26 +02:00
Javier Goizueta 3c12cf629f Optimize overview pixel adjustment for integer-pixel cells 2016-04-25 13:53:59 +02:00
Javier Goizueta 7b2100b51e Adjust overview coordinates to pixel centers 
This makes the adjustment for all grid sizes, not only
for integral number of pixels.
 2016-04-25 13:33:43 +02:00
Javier Goizueta 580ec38ab8 Adjust overview clustered point to pixel centers 
Fixes #240
 2016-04-23 15:07:06 +02:00
Javier Goizueta 65415bb335 Optimize funcion CDB_COlumnType 2016-04-18 19:07:33 +02:00
Javier Goizueta 06ebb27160 Optimize internal funcion _cdb_unlimited_text_column 2016-04-18 18:50:37 +02:00
Javier Goizueta bd5ae84e90 Optimize CDB_ColumnNames 
This implementation is about 1000 times faster
 2016-04-18 18:49:58 +02:00
Javier Goizueta 6908fb4672 Release 0.15.1 
Overviews bugfixes & enhancements
 2016-04-15 18:15:35 +02:00
Javier Goizueta a528a250d4 Merge pull request #234 from CartoDB/231-overviews-text-aggr 
Aggregate small number of text items in overviews
 2016-04-15 18:04:07 +02:00
Javier Goizueta ef43623f77 Remove unneeded variable 2016-04-15 17:58:03 +02:00
Javier Goizueta 09ad550de3 Fix tests 2016-04-15 17:50:47 +02:00
Javier Goizueta 1b0f77aa96 Always retain single-valued aggregated texts 
This makes columns which have the same value in a group to be aggregated
maintain that value (rather than replacing it by the multiple-value
indicator *) whatever the group value is. (Previously this happend
only for small groups)
 2016-04-15 17:49:00 +02:00
Javier Goizueta 45f063d469 Aggregate small number of text items in overviews 
Instead of nulling text fields for non-singleton aggregated records
concatenate distinct text values when they're few (5 or less).
Fixes #231
 2016-04-15 12:37:16 +02:00