 George Opritescu
|
48880507db |
Renamed method, and used present? |
8 ans auparavant |
|
George Opritescu
|
d955ce003a |
Code review changes |
8 ans auparavant |
|
George Opritescu
|
267d082769 |
Fixed typo, and removed instance var |
8 ans auparavant |
|
George Opritescu
|
6232189688 |
Allow error codes, such as 404, to be considered successful, potential solution for #1272 |
8 ans auparavant |
 Andrew Cantino
|
3469ed2a5e |
Add a migration to set url_from_event and remove direct usage of Event `url` payload value |
8 ans auparavant |
|
Andrew Cantino
|
8d8d8d614a |
When the WebsiteAgent receives Events, we do not need to require that they contain a url keyword |
8 ans auparavant |
|
Andrew Cantino
|
39765f8875 |
Rename to `data_from_event` and use Liquid |
9 ans auparavant |
|
Andrew Cantino
|
5eeca709c7 |
Add event_data_path option to the WebsiteAgent to handle data directly in incoming Events |
9 ans auparavant |
 Akinori MUSHA
|
cdfdc7f3c5 |
Introduce Utils.normalize_uri and use it in WebsiteAgent |
9 ans auparavant |
|
Akinori MUSHA
|
8e9013d9ea |
Fix transcoding error when an unknown charset is found |
9 ans auparavant |
 Dustin Miller
|
5f5a080b6d |
Merge branch 'master' of https://github.com/cantino/huginn into rspec-3-update |
9 ans auparavant |
|
Andrew Cantino
|
04be180255 |
Merge pull request #1071 from purposeindustries/strip-cdata |
9 ans auparavant |
|
Dustin Miller
|
c5766d2086 |
Update for rspec3 rails_helpers config, fix shoulda matchers |
9 ans auparavant |
 oroce
|
a796caa306 |
stripping cdata should be the default behaviour |
9 ans auparavant |
|
Akinori MUSHA
|
f8a6230447 |
Switch faraday_middleware to the upstream master |
9 ans auparavant |
|
oroce
|
8afca6fed0 |
stripping cdata from the value |
9 ans auparavant |
|
Akinori MUSHA
|
7bcb5e1374 |
Exclude `deflate` from Accept-Encoding by default |
9 ans auparavant |
|
Andrew Cantino
|
48d5990146 |
Allow url_from_event in the WebsiteAgent to be an Array |
9 ans auparavant |
|
Akinori MUSHA
|
2caf45ab7d |
Use FaradayMiddleware::Gzip in faraday_middleware 0.10.0 |
9 ans auparavant |
 Andrew Cantino
|
8d1a05fb7c |
fix specs |
9 ans auparavant |
|
Andrew Cantino
|
4f319a3ab4 |
Merge branch 'master' of https://github.com/stvnrlly/huginn into stvnrlly-master |
9 ans auparavant |
|
Andrew Cantino
|
3584c8fa5e |
allow integer indexes as strings |
9 ans auparavant |
|
Akinori MUSHA
|
1f49085770 |
Fix a spec for an error message |
9 ans auparavant |
|
Akinori MUSHA
|
130ca6c9af |
Rename the option name to `url_from_event`, suggested by @cantino |
9 ans auparavant |
|
Akinori MUSHA
|
1e336f029e |
Add a spec for the url_on_receive option |
9 ans auparavant |
|
Akinori MUSHA
|
e791f75648 |
Add a new option `use_namespaces` to WebsiteAgent. |
10 ans auparavant |
|
Akinori MUSHA
|
2bb89c4e39 |
Add specs for the extraction type `xml`. |
10 ans auparavant |
|
Andrew Cantino
|
84ebfa18cb |
add a validation that warns the user if they have not provided a path when using JSONPath |
9 ans auparavant |
 stvnrlly
|
5e1730351f |
update some spec scripts to new cleanup time |
9 ans auparavant |
|
stvnrlly
|
795050636f |
add spec for website unzip |
9 ans auparavant |
 Dominik Sander
|
0daea40bdf |
On postgres queries without an ORDER are ordered randomly, this caused |
9 ans auparavant |
 Chris Eidhof
|
b2218df623 |
Added merge mode |
10 ans auparavant |
|
Andrew Cantino
|
991e1466c6 |
fix spec when user agent is different |
10 ans auparavant |
|
Akinori MUSHA
|
5031cbbbac |
Migrate to RSpec's new expect syntax using Transpec. |
10 ans auparavant |
|
Akinori MUSHA
|
c21bada226 |
WebsiteAgent: Provide a variable _response_ for interpolation. |
10 ans auparavant |
|
Akinori MUSHA
|
df907c0290 |
Extend the spec to give a better idea on how to use `to_xpath`. |
10 ans auparavant |
|
Akinori MUSHA
|
0c490aa82d |
Add a Liquid filter `to_xpath`, which quotes a string for use in XPath expression. |
10 ans auparavant |
|
Akinori MUSHA
|
863e2b8c70 |
WebsiteAgent should interpolate values from incoming event payload. |
10 ans auparavant |
|
Akinori MUSHA
|
fca8051e81 |
Add a parser type `text` to WebsiteAgent. |
10 ans auparavant |
|
Akinori MUSHA
|
7b6119f1f2 |
`"text": true` should have meant ".//text()", not "text()". |
10 ans auparavant |
|
Akinori MUSHA
|
a800342c29 |
WebsiteAgent: Add a spec for XPath returning an integer value. |
10 ans auparavant |
|
Akinori MUSHA
|
4d623c5893 |
WebsiteAgent: Introduce per-node XPath evaluation in extraction. |
10 ans auparavant |
|
Andrew Cantino
|
f4df522f2f |
adding a basic RSS agent |
10 ans auparavant |
|
Andrew Cantino
|
fd2e8cd8b6 |
add headers option to WebsiteAgent |
10 ans auparavant |
|
Akinori MUSHA
|
e8751af629 |
Add a `user_agent` option to WebsiteAgent. |
10 ans auparavant |
|
Akinori MUSHA
|
85a7369e65 |
Use Faraday in WebsiteAgent and make HTTP backend library selectable. |
10 ans auparavant |
 Maximilian Clarke
|
9bf3c2c824 |
Updated WebsiteAgent to receive events |
10 ans auparavant |
|
Maximilian Clarke
|
19c005fe45 |
Modified website_agent to take an array of urls |
10 ans auparavant |
|
Andrew Cantino
|
7d9279b871 |
Merge pull request #212 from knu/website_agent-force_encoding |
10 ans auparavant |
|
Akinori MUSHA
|
8ea2ba573f |
Add :xpath support to WebsiteAgent. |
10 ans auparavant |
George Opritescu
Andrew Cantino
Akinori MUSHA
Dustin Miller
oroce
Andrew Cantino
stvnrlly
Dominik Sander
Chris Eidhof
Maximilian Clarke