turtlebasket
/
JobSpy
mirror of https://github.com/Bunsly/JobSpy
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
444 Commits
1 Branch
82 Tags
3.8 MiB
Commit Graph

209 Commits (c1e30a00dff5332154673b8e7af55661e9b07768)

Author SHA1 Message Date
Yariv Menachem bdb70ff4de cleaned some code 2024-12-29 19:03:23 +02:00
Yariv Menachem d417a3d32d cleaned some code 2024-12-29 18:26:00 +02:00
Yariv Menachem 8195c2c884 implemented strategy design pattern for buttons in messages. 
added handler for button callback

Next: implement business logic
 2024-12-29 18:22:52 +02:00
Yariv Menachem 8996c59492 extracted button call back 2024-12-29 17:18:03 +02:00
Yariv Menachem f71bb91b68 fixed imports 2024-12-29 17:14:18 +02:00
Yariv Menachem 7f7d7f96d6 added buttons to job message sent to chat and a callback to update the message 2024-12-29 17:11:05 +02:00
Yariv Menachem 61cb80839c updated command in Telegram 2024-12-29 11:10:17 +02:00
Yariv Menachem 3fcc87e9b7 created defualt handler and another for indeed. 
on bot i can do findAll and find one by one with the command of the site name
 2024-12-26 17:53:31 +02:00
Yariv Menachem 34e85b9261 new handler for goozali 2024-12-26 17:31:55 +02:00
Yariv Menachem f1b127ae44 added search_term to init 2024-12-26 17:25:47 +02:00
Yariv Menachem 4549b2ffc8 new abstract class to identify telegram handler 2024-12-26 17:23:12 +02:00
Yariv Menachem 458728bb71 moved to new folder 2024-12-26 17:19:56 +02:00
Yariv Menachem 257f24ef19 findall command works 2024-12-26 17:14:50 +02:00
Yariv Menachem f010ce51b1 init commit 2024-12-26 16:44:35 +02:00
Yariv Menachem 2d98eb6c1c changed some import, pycharm could recognize jobspy 2024-12-26 11:15:00 +02:00
Yariv Menachem 14115b1dcb removed new insert 2024-12-25 13:59:57 +02:00
Yariv Menachem 80fef6d67b updated insert many method 2024-12-24 18:34:19 +02:00
Yariv Menachem e50766f756 google search not relevant 2024-12-24 12:30:44 +02:00
Yariv Menachem 8495148d0b google sarch not relvant 2024-12-24 12:30:30 +02:00
Yariv Menachem 7fd13c888e added some logs and updated the insert function 2024-12-24 12:29:44 +02:00
Yariv Menachem 54022f2b57 removed the code parse the data to csv 2024-12-24 11:15:07 +02:00
Yariv Menachem 79189f49ef another filter 2024-12-23 18:15:47 +02:00
Yariv Menachem 9a4246901e some fixes and logs 2024-12-23 18:01:07 +02:00
Yariv Menachem b55287b5ec import problem on getting the field choice from main but align classes names 2024-12-22 17:53:04 +02:00
Yariv Menachem cbe3a97a73 fixed not sending the right response and remove it tag 2024-12-22 16:43:48 +02:00
Yariv Menachem 327b13f82d fixed another columns in job post 2024-12-22 16:07:38 +02:00
Yariv Menachem acd3eb6e44 alsign test to main with constants 2024-12-22 15:58:47 +02:00
Yariv Menachem 92cf52d2b6 updated the main flow to current 2024-12-22 15:57:48 +02:00
Yariv Menachem f79a65929b added more keys to filter out 2024-12-22 15:49:59 +02:00
Yariv Menachem c105c31bab filter works 2024-12-19 13:25:55 +02:00
Yariv Menachem 02a838f8ba added logger and error on what job failed 2024-12-19 13:15:09 +02:00
Yariv Menachem 3cabbcff95 added filter by title name to be more accurate 2024-12-19 13:12:39 +02:00
Yariv Menachem d30d58d7f4 fixed location 2024-12-18 18:01:54 +02:00
Yariv Menachem 5098ac22c2 alignment 2024-12-18 17:54:31 +02:00
Yariv Menachem e863199838 moved functio 2024-12-18 17:49:53 +02:00
Yariv Menachem f2d5bb6cfa maped to job post object 
fix the location by goozali ids
 2024-12-18 16:28:55 +02:00
Yariv Menachem ead8eb126d fixed datetime import, new function to create dicts 2024-12-18 14:30:21 +02:00
Yariv Menachem 58f0793181 updated the flow like the test, Next: map to JobPost or use own classes 2024-12-17 19:55:34 +02:00
Yariv Menachem c47c1a7e77 filter by choice and hours works 2024-12-17 19:53:35 +02:00
Yariv Menachem 0565c0ed16 test updated 2024-12-17 19:08:55 +02:00
Yariv Menachem 7971d0fab7 created new component to able test it properly 2024-12-17 19:00:47 +02:00
Yariv Menachem 7926356233 filter by hours old works! next is by filed column 2024-12-16 20:49:04 +02:00
Yariv Menachem bbe3d6df35 added json file to test the mapper, from json response to classes 2024-12-16 20:32:07 +02:00
Yariv Menachem b4454bfc65 add new request called part for smaller response 2024-12-16 15:48:59 +02:00
Yariv Menachem ce7bddf5c3 created new class to hold all data for the big request NEXT: create another based on this to get smaller response 2024-12-15 21:42:53 +02:00
Yariv Menachem c40c4745d7 delted temp scraper 2024-12-15 20:22:04 +02:00
Yariv Menachem a51876e730 fixed sending request to endpoint , the response is 200 2024-12-15 20:21:46 +02:00
Yariv Menachem f02e3f7a73 small changes to help testing 2024-12-15 18:40:32 +02:00
Yariv Menachem 00f13bdf1a current plan to get the response from goozali 2024-12-12 17:34:27 +02:00
Yariv Menachem 3dc15195d5 init commit 
models ready, logic file for goozali based on the linkdin scraper
 2024-12-12 17:22:58 +02:00
Yariv Menachem f0ea89b357 added support for indeed with ,multi locations, fixed parsing class to mongo 2024-12-12 13:37:39 +02:00
Yariv Menachem cb625f325f updated linkdin scrapper to support multi locations and each max retry it will continue to the next location 2024-12-12 12:05:38 +02:00
Yariv Menachem f1c39e47bd fixed location string to be more readable and adde telegram test 2024-12-11 17:57:00 +02:00
Yariv Menachem d6655676f3 added defualt value for creating athe repo 2024-12-11 17:40:40 +02:00
Yariv Menachem bfc83bdc03 added model dump method to fix insert problem to mongo 2024-12-11 17:22:53 +02:00
Yariv Menachem 175acfb918 fixed runing tests 2024-12-11 16:42:38 +02:00
Yariv Menachem bf974467ab fixed runing main 2024-12-11 16:38:45 +02:00
Yariv Menachem f4ebcc2d51 file structure fixed, exported telegram bot and jon collection to another class 2024-12-11 16:26:23 +02:00
Yariv Menachem c6a7729481 removed test line code 2024-12-11 11:35:36 +02:00
Yariv Menachem 968da48728 added env file to store the keys 2024-12-11 11:32:58 +02:00
Yariv Menachem cc782ddfc1 aligned and added the telegram and chat id 2024-12-10 19:29:34 +02:00
Yariv Menachem b147ac7f85 added mongo to save new jobs, new column to jobPost beacause mongo doesnt support date, 2024-12-10 17:54:04 +02:00
Yariv Menachem d388211a92 added options to add more cities 2024-12-10 15:34:43 +02:00
Yariv Menachem 7c002ae76e fixed structure 2024-12-09 16:13:07 +02:00
Yariv Menachem 53a840e53e created main 
fixed israel search on glasdoor and added to gitignore the csv and debug json
 2024-12-08 17:30:06 +02:00
Jason Geffner 4e7ac9a583
Fix Google job search (#223) 
The previous regex did not capture all expected matches in the returned content
 2024-12-04 16:45:59 -06:00
Cullen Watson 338d854b96
fix(google): search (#216) 2024-10-25 14:54:14 -05:00
Cullen Watson 10a3592a0f docs:file 2024-10-24 15:26:49 -05:00
Cullen Watson b7905cc756 docs:file 2024-10-24 15:24:18 -05:00
Cullen Watson f6248c8386
enh: google jobs (#214) 2024-10-24 15:19:40 -05:00
Cullen Watson f395597fdd fix(indeed): offset 2024-10-22 19:25:07 -05:00
Cullen Watson 9f4083380d
indeed:remove tpe (#210) 2024-10-19 18:01:59 -05:00
Olzhas Arystanov 9207ab56f6
fix: extract tests out of src (#209) 2024-10-19 16:56:38 -05:00
Marcel Gozalbo Baró 6bc191d5c7
FEATURE: Add the "ca_cert" setting for providing a Certification Authority certificate in order to use proxies requiring it. (#204) 2024-10-08 17:46:46 -05:00
Cullen Watson 0cc34287f7 fix:turkey 2024-10-02 01:31:00 -05:00
Anton Pikhteryev 923979093b
Add Malta for linkedin country support (#198) 2024-09-19 20:41:22 -05:00
Cullen Watson f7b29d43a2
fix(indeed):sort relevance not date (#197) 2024-09-18 18:42:25 -05:00
Cullen Watson 6f1490458c
fix key error (#186) 2024-08-14 02:54:40 -05:00
Cullen Watson 6bb7d81ba8
change linkedin ep (#185) 2024-08-14 02:39:43 -05:00
Cullen Watson 0e046432d1
fix:variable bug (#181) 2024-08-05 12:47:55 -05:00
Cullen Watson 209e0e65b6
fix:malaysia indeed (#180) 2024-08-03 22:48:53 -05:00
Cullen Watson 8570c0651e
fix:key error (#176) 2024-07-21 13:05:18 -05:00
Cullen Watson 8678b0bbe4
enh: test on pr (#174) 2024-07-19 14:25:25 -05:00
Cullen Watson 60d4d911c9
lock file (#173) 2024-07-17 21:21:22 -05:00
Lluís Salord Quetglas 2a0cba8c7e
FEAT: Optional convertion to annual and know salary source (#170) 2024-07-17 21:05:33 -05:00
Cullen Watson 88c95c4ad5
enh: estimated salary (#169) 2024-07-16 19:20:34 -05:00
Cullen Watson 6330c14879 minor fix 2024-07-15 21:19:01 -05:00
Ali Bakhshi Ilani 48631ea271
Add company industry and job level to linkedin scraper (#166) 2024-07-15 21:07:39 -05:00
Cullen Watson edffe18e65
enh: listing source (#168) 2024-07-15 20:30:04 -05:00
Lluís Salord Quetglas 0988230a24
FEAT: Add Glassdoor logo data if available (#167) 2024-07-15 20:25:18 -05:00
Cullen Watson d000a81eb3
Salary parse (#163) 2024-06-09 17:45:38 -05:00
Cullen Watson ccb0c17660
enh: ziprecruiter full description (#162) 2024-06-09 16:21:01 -05:00
Cullen Watson 89a3ee231c
enh(li): job function (#160) 2024-05-28 16:01:29 -05:00
Cullen 6439f71433 chore: version 2024-05-28 15:39:24 -05:00
adamagassi 7f6271b2e0
LinkedIn scraper fixes: (#159) 
Correct initial page offset calculation
Separate page variable from request counter
Fix job offset starting value
Increment offset by number of jobs returned instead of expected value
 2024-05-28 15:38:13 -05:00
Cullen Watson 5cb7ffe5fd
enh: proxies (#157) 
* enh: proxies

* enh: proxies
 2024-05-25 14:04:09 -05:00
fasih hussain 08d63a87a2
chore: id added for JobPost schema (#152) 2024-05-20 11:45:52 -05:00
Cullen 1ffdb1756f fix: dup line 2024-04-30 12:11:48 -05:00
Lluís Salord Quetglas dcd7144318
FIX: Allow Indeed search term with complex syntax (#139) 2024-04-30 12:05:43 -05:00
Cullen Watson bf73c061bd
enh: linkedin company logo (#141) 2024-04-30 12:03:10 -05:00