This repository was archived by the owner on Nov 6, 2023. It is now read-only.

Ruleset updating mechanism to fetch, verify the authenticity of, and apply new ruleset databases#437

Closed

chaoticsmol wants to merge 164 commits intoEFForg:masterfrom

chaoticsmol:master

Commits on May 22, 2014

Created a simple utility to help automate the task of creating a valid json manifest for ruleset update information
redwire
committed

Commits on May 27, 2014

Merge branch 'master' into makeJSONManifest
redwire
committed
Remove example usage from comments
redwire
committed
Remove db_signature field from update object since the update_signature field will include the hash of the db file
redwire
committed

Commits on May 28, 2014

starting code for checking for updates
redwire
committed

Commits on May 29, 2014

Removed unnecessary uses of string conversions
redwire
committed

Commits on May 30, 2014

Check version of the ruleset release
redwire
committed
Outline code to start handling the new database file source
redwire
committed
Use the XPCOM interface for creating XMLHttpRequests.
redwire
committed
Build the skeleton for applying the update
redwire
committed

Commits on May 31, 2014

Write comments describing the function and parameters to each function
redwire
committed

Commits on Jun 1, 2014

Fill out the helper functions
redwire
committed

Commits on Jun 2, 2014

Commits on Jun 3, 2014

Commits on Jun 8, 2014

Commits on Jun 12, 2014

Compute the hash of the update object automatically and deterministically
redwire
committed

Commits on Jun 16, 2014

Commits on Jun 19, 2014

Commits on Jun 20, 2014

trying to fix up the test
redwire
committed
Merge branch 'master' into rulesetUpdating
redwire
committed
Added function to HTTPSEverywhere prototype to allow for repeating XHR attempts in intervals
redwire
committed
Working on a rewrite to meet new spec reqs
redwire
committed
Write update.json in a more human-readible form that is still parseable by JSON.parse
redwire
committed
Include instructions for computing the digest of update.json to sign and tidy up instructions
redwire
committed
Finished updating rulesetUpdate to meet new spec requirements
redwire
committed
Change order of fields in json spec to match output order
redwire
committed
Encode the hash of the database file as hex to match how the JS code will behave
redwire
committed
Clarify that the hash field is hex-encoded and order the fields alphabetically
redwire
committed
Forgot a bloody comma
redwire
committed
Fixed innappropriate quote
redwire
committed

Commits on Jun 24, 2014

Merge branch 'master' into makeJSONManifest
redwire
committed
Merge branch 'makeJSONManifest' into rulesetUpdating
redwire
committed

Commits on Jun 30, 2014

Merge branch 'master' into rulesetUpdating
redwire
committed
Add commas to key-value pair separator
redwire
committed
Create new example data
redwire
committed
fixed typing mistake in accessing of Ci.nsICryptoHash
redwire
committed
Write a test for update.json signature verification
redwire
committed
Merge branch 'master' into rulesetUpdating
redwire
committed
asserting inside a callback caused test to be considered empty and fail, so hardcoding the data instead
redwire
committed
Fixing the silly things I did
redwire
committed
Simplify expression
redwire
committed
Was addressing the wrong attribute of the converter object
redwire
committed
write values as strings instead of calling Array.join
redwire
committed

Commits on Jul 1, 2014

Add test for hashing of update.json and also hardcoded the data properly
redwire
committed

Commits on Jul 2, 2014

test that the verifier component was created successfully
redwire
committed

Commits on Jul 3, 2014

Creating new testing data
redwire
committed
Create new testing keys, data, and signature
redwire
committed
Update to use new data
redwire
committed
Accidentally added a \n to update.json when experimenting- accounting for that here
redwire
committed
Import and test atob and btoa
redwire
committed
Should not need to convert the signature to binary-encoding
redwire
committed

Commits on Jul 4, 2014

Ignore me
redwire
committed
Revert "Ignore me"
redwire
committed
Write instructions for signing and verifying signatures using openssl dgst instead of rsautl
redwire
committed
New test data with signature and digest that can be verified with new method
redwire
committed
Write an endline at the end of update.json
redwire
committed
New data
redwire
committed
Adding new data
redwire
committed
Finished adding new data but the test still fails
redwire
committed
Try the test with a 1024-bit key and signature based thereupon in case there are compat. issues. Still gets an exception
redwire
committed

Commits on Jul 6, 2014

Mention that the public key can also be DER and then Base64 encoded
redwire
committed

Commits on Jul 7, 2014

Commits on Jul 16, 2014

Commits on Jul 18, 2014

Add default preference values for prefs needed by RS Updater
redwire
committed
cleaned up version comparison test
redwire
committed
Simple script to run a server that files can be fetched from for testing
redwire
committed

Commits on Jul 20, 2014

Commits on Jul 28, 2014

Added required preferences
redwire
committed
Added data for testing purposes
redwire
committed
Added logging for program flow inspection
redwire
committed

Commits on Jul 29, 2014

Commits on Jul 31, 2014

Commits on Aug 1, 2014

Retrying signature generation and making sure the hash is correct
redwire
committed
Re-entered key
redwire
committed
Copied the correct signature in
redwire
committed
Clear data for new data to be entered
redwire
committed
Trying test with new data
redwire
committed
Revert "Trying test with new data"
redwire
committed
Revert "Clear data for new data to be entered"
redwire
committed

Commits on Aug 3, 2014

Remove stuff accidentally merged from features/tests a while ago
redwire
committed

Commits on Aug 4, 2014

Generated new test data but signature verification still fails; signature taken over sha256(update.json)
redwire
committed

Commits on Aug 5, 2014

Commits on Aug 8, 2014

If we do NOT hash UPDATE_JSON and use the signature taken over update.json itself the tests pass
redwire
committed
Clean up pubkey and signature
redwire
committed
Use the test data that passed the unit tests for the last phase of testing
redwire
committed
Updated preferences and did some bugfixing
redwire
committed
Use new test data in rulesetUpdater
redwire
committed

Commits on Aug 9, 2014

New data
redwire
committed
Use Downloads.jsm to download rulesets.sqlite so the binary data does not screw things up
redwire
committed
Had trouble with OS.Path for some reason
redwire
committed
Try to report errors
redwire
committed
Do some renaming to avoid name conflicts with the OS object from osfile.jsm
redwire
committed

Commits on Aug 10, 2014

Put ruleset database in a place where it can be safely replaced and reloaded from
redwire
committed
Removed unused code
redwire
committed
Move volatile db initialization to HTTPSEverywhere
redwire
committed

Commits on Aug 13, 2014

Change names to avoid name clashes with osfile module
redwire
committed
Use a bytearray to download ruleset database file with XHR
redwire
committed

Commits on Aug 14, 2014

Commits on Aug 15, 2014

Ignore hashing test to continue testing with bad update.json data caused by bug fixed by d1148d47af48c4759c59009b92a459b27dbc5ab9
redwire
committed
Store newly downloaded ruleset dbs in profiledir and load from there in HTTPSRules.init if a new db file exists
redwire
committed
Add hash comparison test back in
redwire
committed
Removed my testing data which is known to be faulty after fixing d1148d47af48c4759c59009b92a459b27dbc5ab9
redwire
committed
Clean up my code and rewrite better comments
redwire
committed
Merge branch 'master' into rulesetUpdating
redwire
committed
Removed URLs serving test data
redwire
committed
Remove old signature verification testing data
redwire
committed
Revert "Remove stuff accidentally merged from features/tests a while ago"
redwire
committed
Reset log level
redwire
committed
Turn the ruleset updater on and off when the user toggles the checkbox for it
redwire
committed
Fix typo
redwire
committed
Update the updateJSONSpec
redwire
committed
Use strict equality comparing hash strings
redwire
committed
Rename rulesetUpdate.js to RulesetUpdater.js for consistency
redwire
committed
Remove old fild
redwire
committed
Making changes to appease the mentor gods
redwire
committed

Commits on Aug 16, 2014

Merge remote-tracking branch 'upstream/master'
redwire
committed
Merge branch 'feature/tests'
redwire
committed
Use the new AddonManager module to get the addon version number
redwire
committed
Try to determine the branch name of the extension from the version string
redwire
committed
Prefix temp file with 32 random bytes
redwire
committed
Fixed a syntax error and changed a WARN log to more appropriate NOTE
redwire
committed