huginn/CHANGES.md

Changes

DateOfChange	Changes
Oct 06, 2016	RssAgent is reimplemented migrating its underlying feed parser from FeedNormalizer to Feedjira. 1564
Oct 05, 2016	Migrate to Rails 5. 1688
Oct 05, 2016	Improve URL normalization in WebsiteAgent. 1719
Oct 05, 2016	PushoverAgent now treats parameter options as templates rather than default values. 1720
Sep 19, 2016	Add multipart file upload to PostAgent. 1690
Sep 08, 2016	Allow TwitterUserAgent to retry failed actions. 1645
Aug 16, 2016	EmailDigestAgent now relies on received events, rather in memory. 1624
Aug 08, 2016	DataOutputAgent now limits events after ordering. 1444
Aug 05, 2016	Add api_key option to UserLocationAgent. 1613
Jul 25, 2016	Add LiquidOutputAgent. 1587
Jul 25, 2016	Allow PostAgent headers to interpolate event data. 1606
Jul 25, 2016	Remove smtp.yml configuration file, the SMTP configuration now needs to be done via environment variables. 1595
Jul 25, 2016	Change jsonpath gem to a fork located at https://github.com/Skarlso/jsonpathv2 1596
Jul 20, 2016	Add redirection information to the HttpStatusAgent 1590
Jul 15, 2016	Add changes_only option to HttpStatusAgent which only emit events then the HTTP status changed. 1582
Jul 09, 2016	Add AttributeDifferenceAgent. 1572
Jul 04, 2016	Add setMemory function to the JavaScriptAgent. 1576
Jul 01, 2016	Allow decimal values to be shown on the PeakDetectorAgent graphs. 1574
Jun 30, 2016	Update Heroku installation documentation to match their recent change of creating empty git repositories. 1570
Jun 24, 2016	Docker images: Fix usage of special characters in environment configuration and passing of additional env variables. 1560
Jun 23, 2016	Return to Agent's Events when clicking on the Back button in the Event show page. 1555
Jun 23, 2016	Allow usage of the style tag in E-Mail Agents 1557
Jun 21, 2016	Allow to create custom Agent gems and load them with ADDITIONAL_GEMS. 1366 Look at the huginn_agent README for documentation on how to create Agent gems. Currently available Agent gems: HuginnNlpAgents - query the FREME and DKT Natural Language Processing APIs HuginnWebsiteMetadataAgent - Extracts schema.org microdata, embedded JSON-LD and common metadata tag attributes from HTML HuginnReadabilityAgent - extracts te primary readable content of a website using the readability gem
Jun 20, 2016	Allow HttpStatusAgent include received HTTP header value in emitted Events. 1521
Jun 20, 2016	Fix setting a memory key to falsy values with this.memory(key, falsy) in the JavaScriptAgent. 1551
Jun 18, 2016	Add not in comparison type to the TriggerAgent. 1545
Jun 18, 2016	Ensure the Agent memory is set when triggering a dry run from the Agent show page. 1550
Jun 16, 2016	Allow to set an icon for Scenarios 1427
Jun 16, 2016	Add deleteKey function to JavascriptAgent to delete a key from the Agent's memory. 1543
Jun 14, 2016	Allow the DropboxFileUrlAgent to emit permanent Dropbox links. 1541
Jun 14, 2016	Add button to enable or disable all Agents of a Scenario. 1506
Jun 14, 2016	Update nokogiri to 1.6.8 for security fixes. 1540
Jun 08, 2016	Fix multi-process Docker image on the overlay storage driver. 1537
Jun 05, 2016	Fix storing array/hashes in the JavaScriptAgents memory. 1524
May 31, 2016	Add Agent connection status icons to Agent table. 1482
May 29, 2016	Add time tracking to HttpStatusAgent. 1517
May 20, 2016	Add parse_mode option to TelegramAgent to embed HTML or Markdown. 1509
May 18, 2016	Show recently received events in dry run modal. 1483
May 16, 2016	Prevent duplicate events from being generated when using DelayedJob and Postgres. 1501
May 12, 2016	Improve Agent and Scenario forms: Allow to configure the Agents event target and to jump to source/target Agent from the edit form. 1447
May 10, 2016	Add button to toggle visibility of disabled Agents. 1464
May 09, 2016	Fix usage of deprecated API version in TwitterStreamAgent. 1492
Apr 30, 2016	Make XML namespaces of DataOutputAgent optional. 1411
Apr 29, 2016	Fix internal Jobs being shown as deleted in Job Management page. 1462
Apr 27, 2016	Fix issue in default NGINX SSL configuration. 1455
Apr 26, 2016	Add TwitterActionAgent to retweet or favorite tweets. #1181
Apr 26, 2016	Validate Agent options JSON before submitting it. 1434
Apr 24, 2016	Allow to delete the Scenario's Agents with it. 1446
Apr 22, 2016	Allow to (re)import exported Credential JSON files. 1394
Apr 20, 2016	Add TwilioReceiveTextAgent. 1418
Apr 19, 2016	Add Nitrous.io Quickstart button. 1428
Apr 19, 2016	Do not run/enqueue event propagation when a AgentPropagateJob is already enqueued. 1432
Apr 19, 2016	Fix publishing to MQTT channels with the MqttAgent. 1440
Apr 16, 2016	Pass request headers to receive_web_request. 1415
Apr 13, 2016	Add button to Job Management page retry all queued Jobs. 1423
Apr 12, 2016	Allow to configure the format of header names in Events that PostAgent emits. 1340
Apr 11, 2016	Allow to provide a custom scenario JSON for new Users via DEFAULT_SCENARIO_FILE. 1404
Apr 10, 2016	Improve docker images and tag every image with the commit SHA. 1359
Apr 10, 2016	Fix SMS sending in TwilloAgent. 1414
Apr 05, 2016	Simplify the log format for Dry Run. 1386
Apr 04, 2016	PostAgent allow sending arbitrary string data. 1402
Mar 31, 2016	Add TelegramAgent. 1381
Mar 30, 2016	Add Agent actions menu to Agent show and Agent Events page. 1374
Mar 30, 2016	Add round trip option to GoogleFlightAgent. 1384
Mar 30, 2016	Ensure cloned Agents stay in the same Scenario. 1377
Mar 27, 2016	Allow usage of HTML table tags/attributes in E-Mail Agents. 1380
Mar 27, 2016	Add tabs to Dry Run result modal. 1371
Mar 26, 2016	Make DelayedJob logs visible when running in foreground. 1360
Mar 26, 2016	Add GoogleFlightsAgent. 1367
Mar 22, 2016	Add JsonParseAgent. 1364
Mar 21, 2016	Add AftershipAgent. 1354
Mar 18, 2016	Introduce concept to handle files, introduces four new agents: 1301 LocalFileAgent (source/consumer), can watch for changes of a file/directory, when schedules just emits an event for every file. Writes received event data to a local file. S3Agent (source/consumer), watches an S3 bucket for changes or emits the files on interval. Writes received event data to a S3 Bucket. ReadFileAgent (birdge/consumer), takes the file pointer from one of the source agents, reads the file and emits to contents so that other agents that do not yet support the file pointers can work with the data. CsvAgent (consumer),parses CSV data, it can consume a file pointer or with with data supplied via the event payload. Generates CSV from received events.
Mar 17, 2016	Add admin user management interface to create, edit, deactivate and delete users. 1330
Mar 16, 2016	Ensure the JavaScriptAgent uses the configured timezone. 1356
Mar 16, 2016	Add age column with default sort to prioritize new Agents in the index view. 1348
Mar 13, 2016	Rescue and log email sending errors. 1335
Mar 12, 2016	Hide the Agent's memory in Agent show page per default. 1326
Mar 12, 2016	Fix TwitterStreamAgent database connection in use and restart issues. 6ee094af9
Mar 09, 2016	Add support for ruby 2.3.0 by ensuring the tests pass. 7f50503da
Mar 08, 2016	Add json liquid filter to serialize data to a JSON string. 1329
Mar 07, 2016	Allow specifying the content-type of send E-Mails. 1325
Mar 06, 2016	Add BoxcarAgent for Boxcar.io. 1323
Mar 02, 2016	Update Rails to 4.2.5.2. cf9e9bd04
Mar 02, 2016	Allow TwitterUserAgent to follow the users own timeline. 1321
Feb 26, 2016	Added TwitterFavorites Agent for following the favorites of a Twitter user. Thanks @jngai and @bigretromike!
Feb 26, 2016	Added HttpStatusAgent for pinging web servers and returning the resulting HTTP status code. Thanks @darrencauthon!
Feb 20, 2016	A from option can now be specified on email agents. (If you're using Gmail, it may still show your normal address unless you add the new address as a valid sender on the account.)
Feb 20, 2016	Added a recommended PORT to the .env.example file.
Feb 15, 2016	Allow usage of spring in development by setting SPRING in .env.
Feb 14, 2016	Bug fix: missing Credential no longer 500 errors during an import.
Feb 12, 2016	Add no_bulk_receive! option to ensure Events are processed individually in certain Agents.
Feb 7, 2016	Add http_success_codes option to the WebsiteAgent to treat more than just 200 as success codes.
Feb 7, 2016	Add support for writing Capybara specs.
Feb 4, 2016	Bug fix: Fix mysql connection check for multi-process docker image.
Feb 3, 2016	The GoogleCalendarPublishAgent now accepts Liquid in the calendar_id option.
Feb 1, 2016	Fix Guard and add rack-livereload for development.
Jan 30, 2016	Add support to the ManualEventAgent for Liquid formatting and creating multiple Events.
Jan 28, 2016	PushbulletAgent can push to all devices.
Jan 26, 2016	Update Rails to 4.2.5.1 for security and unify configuration files.
Jan 24, 2016	Docker upgrades and fixes.
Jan 22, 2016	Upgrade devise to 3.5.4 to address CVE-2015-8314.
Jan 20, 2016	Update nokogiri for CVE-2015-7499.
Jan 20, 2016	Add DigestAgent which collects any Events sent to it and emits them as a single event.
Jan 16, 2016	Update celluloid and delayed_job to avoid potential memory issues.
Jan 16, 2016	PostAgent can emit Events with the resulting data from the server.
Jan 15, 2016	Allow Liquid formatting of the recipients option of email Agents.
Jan 14, 2016	Add new block tags regex_replace/regex_replace_first to Liquid.
Jan 14, 2016	Events received by the WebsiteAgent do not need to contain a url value, switching to usage of url_from_event instead.
Jan 14, 2016	Liquid block tag regex_replace and regex_replace_first added.
Jan 12, 2016	WebhookAgent supports reCAPTCHA.
Jan 8, 2016	Remove schema.rb from git.
Jan 3, 2016	Add itunes namespace to DataOutputAgent.
Dec 26, 2015	Allow multiple users to import the same Scenario.
Dec 26, 2015	WebsiteAgent can accept a data_from_event Liquid template instead of a URL.
Dec 19, 2015	Update nokogiri to 1.6.7.1 because of security CVEs.
Dec 10, 2015	Bug fix: Do not try to load .env file on Heroku.
Dec 8, 2015	Export Agents in GUID order in Scenarios.
Nov 25, 2015	Update to newest uglifier and nokogiri gems due to security alerts.
Nov 14, 2015	Bug fix: WebsiteAgent handles unicode URLs better.
Nov 12, 2015	Bug fix: fix a memory leak caused by starting a new LongRunnable::Worker when the old one is still restarting.
Nov 11, 2015	EventFormattinghAgent can be dry run.
Nov 8, 2015	Added media namespace to DataOutputAgent output, supporting 'media:content' nodes.
Nov 5, 2015	Bug fix: CommanderAgent can now be manually run correctly.
Nov 4, 2015	DataOutputAgent can push to PubSubHubbub hubs with push_hubs option.
Oct 31, 2015	DelayAgent max_emitted_events option added to limit the number of events which should be created.
Oct 30, 2015	TumblrPublishAgent reblog post_type added.
Oct 28, 2015	TumblrPublishAgent emits the created post.
Oct 27, 2015	WebhookAgent can have a custom response message.
Oct 27, 2015	DIAGRAM_DEFAULT_LAYOUT option added to select Graphviz layout.
Oct 27, 2015	ShellCommandAgent has new suppress_on_failure and suppress_on_empty_output options.
Oct 24, 2015	TwitterStream does not complain when not configured.
Oct 23, 2015	Bug fix: RSSAgent now sorts correctly with events_order.
Oct 22, 2015	Bug fix: BeeperAgent added to push messages to the Beeper mobile app.
Oct 20, 2015	WebsiteAgent unwraps cdata sections in XML.
Oct 20, 2015	force_stop command added to production.rake.
Oct 18, 2015	Bug fix: CommanderAgent can now control any other Agent type.
Oct 17, 2015	TwitterSearchAgent added for running period Twitter searches.
Oct 17, 2015	GapDetectorAgent added to alert when no data has been seen in a certain period of time.
Oct 12, 2015	Slack agent supports attachments.
Oct 9, 2015	The TriggerAgent can be asked to match on fewer then all match groups.
Oct 4, 2015	Add DelayAgent for buffering incoming Events
Oct 3, 2015	Add SSL verification options to smtp.yml
Oct 3, 2015	Better handling of 'Back' links in the UI.
Sep 22, 2015	Comprehensive EvernoteAgent added
Sep 13, 2015	JavaScriptAgent can access and set Credentials.
Sep 9, 2015	Add AgentRunner and LongRunnable to support long running agents.
Sep 8, 2015	Allow url_from_event in the WebsiteAgent to be an Array
Sep 7, 2015	Enable strict: false in database.yml
Sep 2, 2015	WebRequestConcern Agents automatically decode gzip/inflate encodings.
Sep 1, 2015	WebhookAgent can configure allowed verbs (GET, POST, PUT, ...) for incoming requests.
Aug 21, 2015	PostAgent supports "xml" as content_type.
Aug 3, 2015	Dry Run allows user to input an event payload.
Aug 1, 2015	Huginn now requires Ruby >=2.0 to run.
Jul 30, 2015	RssAgent can configure the order of events created via events_order.
Jul 29, 2015	WebsiteAgent can configure the order of events created via events_order.
Jul 29, 2015	DataOutputAgent can configure the order of events in the output via events_order.
Jul 20, 2015	Control Links (used by the SchedularAgent) are correctly exported in Scenarios.
Jul 20, 2015	keep_events_for was moved from days to seconds; Scenarios have a schema verison.
Jul 8, 2015	DataOutputAgent supports feed icon, and a new template variable events.
Jul 1, 2015	DeDuplicationAgent properly handles destruction of memory.
Jun 26, 2015	Add max_events_per_run to RssAgent.
Jun 19, 2015	Add url_from_event to WebsiteAgent.
Jun 17, 2015	RssAgent emits events for new feed items in chronological order.
Jun 17, 2015	Liquid filter unescape added.
Jun 17, 2015	Liquid filter regex_replace and regex_replace_first added, with escape sequence support.
Jun 15, 2015	Liquid filter uri_expand added.
Jun 13, 2015	Liquid templating engine is upgraded to version 3.
Jun 12, 2015	RSSAgent can now accept an array of URLs.
Jun 8, 2015	WebsiteAgent includes a use_namespaces option to enable XML namespaces.
May 27, 2015	Validation warns user if they have not provided a path when using JSONPath in WebsiteAgent.
May 24, 2015	Show Agents' name and user in the jobs panel.
May 19, 2015	Add "Dry Run" to the action menu.
May 23, 2015	JavaScriptAgent has dry run and inline syntax highlighting JavaScript and CoffeeScript.
May 11, 2015	Make delayed_job sleep_delay and max_run_time .env configurable.
May 9, 2015	Add 'unescapeHTML' functionality to the javascript agent.
May 3, 2015	Use ActiveJobs interface.
Apr 28, 2015	Adds Wunderlist agent.
Apr 25, 2015	Allow user to clear memory of an agent.
Apr 25, 2015	Allow WebsiteAgent to unzip compressed JSON.
Apr 12, 2015	Allow the webhook agent to loop over returned results if the payload_path points to an array.
Mar 27, 2015	Add wit.ai Agent.
Mar 24, 2015	CloudFoundry integration.
Mar 20, 2015	Upgrade to Rails 4.2.
Mar 17, 2015	Add new "Dry Run" feature for some Agents.
Feb 26, 2015	Update to PushBullet API version 2.
Feb 22, 2015	Allow Agents to request immediate propagation of Events.
Feb 18, 2015	Convert \n to actual line breaks after interpolating liquid and add line_break_tag.
Feb 6, 2015	Allow UserLocationAgent to accept min_distance to require a certain distance traveled.
Feb 1, 2015	Allow a body key to be provided to set email body in the EmailAgent.
Jan 21, 2015	Allow custom icon for Slack webhooks.
Jan 20, 2015	Add max_accuracy to UserLocationAgent.
Jan 19, 2015	WebRequestConcern Agents can supply disable_ssl_verification to disable ssl verification.
Jan 13, 2015	Docker image updated.
Jan 8, 2015	Allow toggling of accuracy when displaying locations in the UserLocationAgent map.
Dec 26, 2014	Do not try to monkey patch the mysql adapter on heroku
Dec 7, 2014	Update Rails to 4.1.8
Dec 3, 2014	Access sites with invalid SSL
Nov 22, 2014	Make the website agent support merge events
Nov 8, 2014	Added DeDuplicationAgent
Nov 5, 2014	Made latlng accessible to liquid
Nov 4, 2014	Enable AgentLog to handle a message with invalid byte sequences; upgrade slack-notifier to 1.0.0; use webhook URLs instead of tokens.
Nov 2, 2014	Fixes WorkerStatusController for postgresql; updated rails to 4.1.7; added a PDF info agent; commander agent can configure other Agents.
Nov 1, 2014	Fixes postgres and DST related spec issues
Oct 27, 2014	RSSAgent: Include url in addition to urls in each event.
Oct 23, 2014	Assume an uploaded scenario file (JSON) is encoded in UTF-8
Oct 20, 2014	Made weather agent dependent on user location
Oct 16, 2014	Make event-indicator a link to the events page, with new events highlighted
Oct 15, 2014	Add dropbox agent to emit urls for the given paths
Oct 14, 2014	Upgrade Devise to 3.4.0; mqttAgent: Ignore a retained message previously received
Oct 12, 2014	Add a button to view full error logs; allow longer than 2000 characters
Oct 10, 2014	Dropbox watch agent
Oct 9, 2014	Make the scheduler frequency tunable via ENV; add CommanderAgent, which controls other agents on a schedule or incoming event; disable the CSRF warning in WebRequestsController.
Oct 5, 2014	OpenShift deployment
Oct 1, 2014	Migrate to Rspec3
Sep 29, 2014	Refactor OmniAuth integration
Sep 25, 2014	TumblrPublishAgent
Sep 24, 2014	Refactor OmniAuth configuration and fix it with 37Signals; introduce FontAwesome; enable download of user credentials; improve docs for ForecastIO in WeatherAgent.
Sep 22, 2014	Improvements to bin/setup_heroku
Sep 21, 2014	Reduce gems to save RAM
Sep 17, 2014	Give user an option to drop pending events when enabling an agent.
Sep 16, 2014	Improvements to UserLocationAgent
Sep 14, 2014	Allow some agents to be configured via HTML forms rather then JSON.
Sep 13, 2014	Calculate IDs in RssAgent if none are available.
Sep 12, 2014	Make tables sortable by most columns.
Sep 8, 2014	SchedulerAgent added, allowing granular control of Agent schedules. Agents can now control other Agents via ControlLinks. Liquid filter to_uri added.
Sep 7, 2014	Optional delayed_job_web replaced by a custom UI for managing failed and queued jobs.
Sep 6, 2014	Agent's last_event_at is now updated only on Event creation, not on updates.
Sep 4, 2014	Spring, an application preloader intergated with Rails 4.1, has been added.
Sep 3, 2014	Liquid interpolation in the WebsiteAgent now has a _response_ variable available.
Aug 31, 2014	Fix a bug where AgentLogs errored after a referenced Event was deleted. HumanTaskAgent can emit separate events for each answer.
Aug 30, 2014	Set charset/collation properly for each text column if using MySQL. One-click "Deploy to Heroku" button added in README.
Aug 28, 2014	Liquid filter to_xpath added, which quotes a string for use in XPath expression.
Aug 26, 2014	Transition to new Services model for managing external authorization with omniauth.
Aug 21, 2014	WebsiteAgent has a new text parser type. Scenario tags have a customizable foreground and background color. HTML is sanitized and supported in emails.
Aug 20, 2014	Support for markdown in Scenario descriptions added.
Aug 17, 2014	TwitterStream no longer tries to run disabled Agents. Sleep and thread bugs fixed in the EM code.
Aug 13, 2014	created_at added as an available Liquid variable. Enable Graphviz on Heroku.
Aug 12, 2014	Add an environment variable (DEFAULT_HTTP_USER_AGENT) to set a global default User-Agent value. Hover menu to the "Agents" nav link added.
Aug 9, 2014	ChangeDetectorAgent added.
Aug 8, 2014	Make PostAgent use WebRequestConcern, adding options for Basic Auth and User-Agent.
Aug 5, 2014	Use 'net-ftp-list' gem to parse ftp directory listing.
Aug 1, 2014	Adding a badge to each Agent node in a diagram.
Jul 31, 2014	Allow HipchatAgent to use a shared Credential.
Jul 29, 2014	The upstream Agent is now available in the EventFormattingAgent in Liquid via the agent key. The WebsiteAgent is now much more powerful, supporting full XPath evaluations in extractions.
Jul 26, 2014	Easy Heroku deployment added and document in the wiki!
Jul 25, 2014	Simple RSSAgent added for parsing RSS feeds (the WebsiteAgent has always been able to do this, but this new Agent is simpler). Nicer Agent diagrams.
Jul 20, 2014	Email Agents can send to more than one recipient using the new recipients array.
Jun 29, 2014	PostAgent can send more HTTP verbs, use both json and html form encoding, and merge event payloads.
Jun 18, 2014	Scenarios added, allowing Agents to be grouped, imported, and exported. interpolated_options added so that most Agent options can contain Liquid markup.
Jun 12, 2014	XML namespaces are ignored by the WebsiteAgent when evaluating XPath.
Jun 9, 2014	User edit form split and cleaned up.
Jun 8, 2014	Upgraded to Rails 4.1.1.
Jun 5, 2014	MQTTAgent added.
Jun 1, 2014	SlackAgent added. Liquid tag for accessing Credentials added. Requests to /worker_status no longer spam the log. GoogleCalendarAgent added.
May 19, 2014	ImapFolderAgent added.
May 11, 2014	Combine some of the Foreman processes into threads for lower memory usage.
May 6, 2014	Agents can be disabled or enabled.
May 5, 2014	JiraAgent added.
May 3, 2014	If you're using Capistrano, cap sync:db:down now works correctly to pull your production DB to your local environment.
May 1, 2014	Upgrade to Bootstrap 3.1.1
Apr 20, 2014	Tons of new additions! FtpsiteAgent; WebsiteAgent has xpath, multiple URL, and encoding support; regexp extractions in EventFormattingAgent; PostAgent takes default params and headers, and can make GET requests; local Graphviz support; ShellCommandAgent; BasecampAgent; HipchatAgent; and lots of bug fixes!
Apr 10, 2014	WebHooksController has been renamed to WebRequestsController and all HTTP verbs are now accepted and passed through to Agents' #receive_web_request method. The new DataOutputAgent returns JSON or RSS feeds of incoming Events via external web request. Documentation is on the wiki..
Jan 2, 2014	Agents now have an optional keep_events_for option that is propagated to created events' expires_at field, and they update their events' expires_at fields on change.
Jan 1, 2014	Remove symbolization of memory, options, and payloads; convert memory, options, and payloads to JSON from YAML. Migration will perform conversion and adjust tables to be UTF-8. Recommend making a DB backup before migrating.
Nov 6, 2013	PeakDetectorAgent now uses window_duration_in_days and min_peak_spacing_in_days. Additionally, peaks trigger when the time series rises over the standard deviation multiple, not after it starts to fall.
Jun 29, 2013	Removed rails_admin because it was causing deployment issues. Better to have people install their favorite admin tool if they want one.
Jun, 2013	A number of new agents have been contributed, including interfaces to Weibo, Twitter, and Twilio, as well as Agents for translation, sentiment analysis, and for posting and receiving webhooks.
Mar 24, 2013	Refactored loading of Agents for check and receive to use ids instead of full objects. This should fix the too-large delayed_job issues. Added system_timer and fastercsv to the Gemfile for the Ruby 1.8 platform.
Mar 18, 2013	Added Wiki page about the Agent API.
Mar 17, 2013	Switched to JSONPath for defining paths through JSON structures. The WebsiteAgent can now scrape and parse JSON.