html - Scraping a page with awkwardly formatted JSON in python -

-

I am scraping a webpage for data and it has a format: 

  & Lt;! - Web header here - & gt; ["Foo": "Bar", "Foo 2": "Bar 2"}, {"Foo 3": ["Hello", "World"], "Foo 4": "Bar 4"}, ... ] & Lt;! - Web footer here - & gt;   
 The issue is that JSON appears on the page with other content, and within the quoted list in the JSON list in the source of the page, inside the 'Pre' tag, other HTML tags inside JSON Therefore with:  
  & lt; Pre & gt; "[[" Foo ":" bar ", & lt; p & gt;" Foo2 ":" bar 2 "& lt; / p & gt;}, ...]" & lt; / Pre & gt;   
 Is there a way to capture this unstable formatting and get a list of JSON objects, which is given to JSON-Objects of the string-off-a-list? Preferably getting rid of embedded tags in this process?  
  Edit:  I have now installed and started learning Sundarasup 4 recommended by Mauricio, but I am still coming for a while. 'On soup. The operator gives me access  
  & lt; Pre & gt; [{... (well formatted JSON, but still inside the tag) ...}]   
  HTML:  ( & lt; east & Gt;  code has some headers on top and bottom.)  
  & lt; Pre & gt; [{"Title": â ???? Blahâ ????, "refs": [A, A, ????, a ???? AA, ????], "Description": [A "A", "A", "A", "A", "A", "A": [A. ???: One ???? A "}], {" title ": an" aa "," riffs ": [an aan ????, a ?? ?? aa ????]," description ": [A, A,? ???, A, A, ????, A 'A',], ?? Ai ????: [[AC ??? A: ??? AA ????}]}] & Lt; / pre & gt;    
 
 
 To get more quotes and spaces Required.  
 Then, you can use the JSSN string to load:  
  Import jsson bs4 import from beautiful soup data = "" "& lt ; Div & gt; & Lt; Pre & gt; "[" Foo ":" Bar ", 
" foo2 ":" Bar 2 "& lt; / p & gt;}]" & lt; / Pre & gt; & Lt; / Div> Soup = Beautiful soup (data) json_data = Soup.pre.text.strip ('' ') Print json.loads (json_data)   
 Print:    
  Quotes inside  pre  are not normal and you should change them:  
  # - * - Coding: UTF-8 - * - Imports imported from BS 4 Jason Sundasup Data = "U" "" "> 
>  [{" Title ": â ???? blahâ ????," refs ": [A, A, ????, "A", "A", "A", "A", "A": [A: "A", "A", "A" One ???? one "}]}, {" title ": The "AA", "riffs" [a Aaan ????, â ?? ?? Aa ????], "description": [A, A, ????, A, A, ????, A 'A',],? ??? Ai ????: [[AC ??? a: ??? AA ????}]}] & lt; / Pre & gt; & Lt; / Div & gt; "" "Soup = Beautiful soup (data) json_data = soup.pre.text.encode ('utf-8'). Bar ('' ') .replace (' '' ',' ''). Replace (print Json.loads (json_data)   
 Print:  
  [[u'a ': [(U'a': u'a '}] , You 'u': '[u', 'u'], u desecration ': [u', 'you', you '], u'tital': u 'blah'}, {o '': [ [U'a ': u'a']], you'fes': [u'a ', you'], u'description ': [u'a', u'a ', u'a'], U'title ': u'a'}]

Comments

Post a Comment

Popular posts from this blog

ios - Adding an SKSpriteNode to SKScene from a child SKSpriteNode -

-
I have a SKScene where I am adding an SKSpriteNode I have subclassed the SKSpriteNode class to create this node. In the subclass I am defining some SKActions on Sprite. What do I want to do when the end of this phantom ends the SKAction sequence, then I add a new Prayer node to this scene. How is this possible. The following code is mine: The code for the sequence is that I'm running on the Scansprinitode subclass (TEMissileNode): - SKAction * moveDown = [SKAction moveToY: Self.position.y - 20 Duration: 0.2]; SKAction * animation = [SKAction animateWithTextures: textures timePerFrame: time / 7]; SKAction * moveMissileProjectile = [SKAction Moving: Pointoffscreen Term: Time]; SKAction * group = [SKAction group: @ [animation, movement projectile]]; SKAction * Sequence = [SKAction Sequence: @ [Hilldown, Group, [SKAction removalFromParent]]]; [Self run action: sequence]; From the main scene, I call those actions that execute these tasks TEMissileNode * missile = [tmissil...
Read more

Matlab transpose a table vector -

-
An embarrassing simple question seems to be, but how can I move a Matlab table vector? aTableT = aTable '; I tried a standard syntax for the simple interaction of a line vector to a line vector aTable : ATableT = reshape (aTable, 1, Height (aTable)); and aTableT = rot90 (aTable); According to the head, the last time table should work for table, see. However, I get this error code: Error type in using table / permit (line 396) Undefined function 'permute' for the input arguments. Error in rot 90 (line 29) b = magnitude (b, [2 1 3: ndims (a)]); NB: fliplr is not useful either pretty sure I have covered clear angles - any ideas? Thanks! Try changing your table into an array, move it, then back to a table In other words, try doing this: aTableArray = table2array (aTable); ATableT = array 2table (aTableArray. '); I have also read the document for rot90 , and it says that rot90 is definitely working for tables Do, and I find you...
Read more

c# - Textbox not clickable but editable -

-
I have a small form with 10 text boxes, I have set them in the correct tab order. I want them on my tab service I was wondering if there is a way to set the text box so that they can be selected for editing until they are tabbed. That is ... I do not want the end user to edit the text box to click on them, I just want to make them editable through tabu. this should do the trick public partial category poor text box: Text Box {Safe Override Zero WndProc (Ref: Message Message) {if (m.msg == (Int) WM.LBUTTONDOWN) {Return; // mount down events} base.WndProc (ref m); }} Window message enum can be found. How to do this without anherizing: text box : class EatMouseDown: netwindows {safe override zero WndProc (ref message message) {if (m.msg == (int) WM.LBUTTONDOWN) {return; } Base.WandProc (Ref M); }} Safe Override Zero Onload (EventEurge E) {base.OnLoad (e); How to do this without any part: left a clean part, whatever is important, this can be a buggy but it works R...
Read more